Setting up "Colouring Austria" platform

Thesis Type: Bachelor

Suggested by: Please contact Dr. Merve Keskin, merve.keskin@plus.ac.at 

Keywords: Building data, open platforms, data visualization, citizen science 

Objective: How many buildings are there in a city? What are their characteristics? Where are they located and how do they contribute to the city? How adaptable are they? How long will they last, and what are the environmental and socio-economic implications of demolition?  

This Bachelor thesis will focus on setting up the "Colouring Austria" platform, gathering building footprints for Salzburg, Linz, and Graz and enriching this building information with diverse thematic attributes. The platform will be based on the open code available at https://github.com/colouring-cities. The research is conducted in collaboration with the University of Salzburg, UniGraz and I:TU and will provide the Bachelor student with the opportunity to work in a multi-disciplinary team. 

Short description/Info about the project: The "Colouring Austria" aims to support Austrian cities in their transition towards climate-neutral and sustainable urban environments through active citizen participation and the crowdsourced data. Building upon the international Colouring Cities Research Programme (CCRP) and successful implementations in cities including London, Dresden, and Sydney, among others (Roper et al., 2022; Danke et al., 2024; Hecht et al., 2023), this research-led initiative will establish Austria's first comprehensive open-data platform dedicated to urban sustainability and facilitates transparent and inclusive data collection and visualization with a thematic focus on energy performance, building typologies, and mobility patterns. 

Start: As soon as possible  

Prerequisites/qualification: Familiarity with GIS, PostgreSQL, github 

POI Recommendation Based on "Sense of Place" extracted from LLMs

 Suggested by: Omid Reza Abbasi, Johannes Scholz and Dominik Kowald (KnowCenter)

Keywords: POI Recommendation, Sense of Place, LLMs

Objective:

1. Develop a methodology for extracting features that capture "sense of place" from textual and visual data using LLMs. This involves exploring techniques such as sentiment analysis, topic modeling, style extraction, and image captioning to identify emotional, cultural, and atmospheric attributes of locations. 

2. Evaluate the impact of "sense of place" features on the performance of location-based recommender systems. This includes comparing the performance of recommender systems with and without these features, using metrics such as user satisfaction, engagement, and discovery of unique experiences. 

3. Investigate the applicability of "sense of place" feature engineering across different location types and user demographics. This involves testing the proposed methodology on various datasets, including restaurant reviews, travel blogs, and social media posts related to tourist attractions and local events. 

Short Description: Location-based recommender systems play a crucial role in helping users discover and experience places that align with their interests. However, traditional approaches often focus on objective attributes like distance, ratings, and popularity, neglecting the subjective and emotional dimension of "sense of place." This thesis proposes to investigate how Large Language Models (LLMs) can be utilized to extract features that capture the unique atmosphere, cultural significance, and emotional resonance of locations, thereby enhancing the personalization and relevance of recommendations. The core challenge addressed in this thesis is the inability of existing location-based recommender systems to understand and incorporate the intangible qualities that contribute to a location's "sense of place." User reviews, social media posts, and geotagged photos often contain valuable insights into the emotional and cultural aspects of a location, but these are frequently overlooked by conventional methods. This thesis aims to explore how LLMs can be leveraged to extract these features, enabling a more thorough understanding of user preferences and place characteristics. 

Start: Anytime

Relevant Studies:

Wan, Zhizhong, et al. "LARR: Large Language Model Aided Real-time Scene Recommendation with Semantic Understanding." Proceedings of the 18th ACM Conference on Recommender Systems. 2024. 

Location-Based Recommendation Using Fine-Tuned LLMs

 Suggested by: Omid Reza Abbasi, Johannes Scholz and Dominik Kowald (KnowCenter)

Keywords: Location Recommendation, LLMs, Fine-Tuning

Objective:

1. To investigate the application of LLM reasoning to enhance location-based recommender systems. 

2. To explore the effectiveness of zero-shot CoT prompting for generating relevant location-based recommendations. 

3. To compare the performance of the proposed LLM-based location-based RS approaches against traditional methods. 

Short Description: In this research, the selected LLM will be trained on the preprocessed datasets using appropriate training and validation splits. We will select one or more pre-trained Large Language Models as the base for fine-tuning. The selection will consider factors such as model size, architecture, availability, and prior performance on text-based tasks. Potential candidates include models from the GPT family (e.g., GPT-2, GPT-Neo), open-source alternatives like Llama, or task-specific models. The chosen LLM(s) will be initialized with their pre-trained weights. For models with a fixed input sequence length, we will ensure that the constructed input prompts do not exceed this limit. If necessary, truncation or other techniques to handle long sequences will be explored. The fine-tuning process will involve training the selected LLM(s) on the prepared training data using appropriate training objectives. The specific objective will depend on the recommendation task being addressed (e.g., next POI prediction, rating prediction, recommendation generation).  

Start: Anytime

Relevant Studies:

Lin, Xinyu, et al. "Data-efficient Fine-tuning for LLM-based Recommendation." Proceedings of the 47th international ACM SIGIR conference on research and development in information retrieval. 2024. 

Bai, Zhuoxi, et al. "Finetuning Large Language Model for Personalized Ranking." arXiv preprint arXiv:2405.16127 (2024).