DynaWeek #6
Hackathon Week 2023
The DynaWeek
Watts UP
The whole story
The idea emerged from the need for an efficient tool for planning solar roof installations. Existing solutions in this field were often not only expensive but also lacked the desired functionality. The team members were motivated to stay true to their commitment to Green Tech.
An open-source tool for planning solar roof installations was created by analyzing shadow patterns on one's own property. This allows the identification of suitable positions for solar panels. Additionally, a 3D model of the property is displayed, and individual roofs can be marked. This enables detailed solar planning for each roof, facilitating the installation of efficient solar systems.
Technologien
Tätigkeiten
Your Story
The whole story
Curiosity was sparked by the question of how far the creative capabilities of ChatGPT could be utilized in an interactive experience. Developing a story in a browser game where players control the narrative through decisions seemed like a fascinating way to explore the limits of ChatGPT and provide an entertaining gaming experience.
In this project, an engaging browser game was created where players shape a unique story with the help of ChatGPT. Based on a bulleted character description, players make decisions after each chapter that influence the course of the story. The system not only generates the progression of the plot but also an avatar image of the character, as well as scenic background and plot images. The result is an interactive experience that utilizes research in the ChatGPT and Prompt Engineering fields.
Technologien
Tätigkeiten
ChEK UR DEFENSE
The whole story
Passion for game design and development laid the foundation for the 'ChEK UR DEFENSE' project. In this project, a small Tower Defense game was developed, inspired by the popular game 'Plants vs. Zombies'. The player's goal is to cleverly place towers to prevent approaching enemy hordes from reaching the 'goal zone'. Well-thought-out generation and expenditure of gold as a central resource are core elements of the game and determine victory or defeat. Across multiple levels, players can place towers that either directly damage enemies, slow down enemies, or generate gold directly but do not cause damage.
The development of 'ChEK UR DEFENSE' allowed participants to gain diverse and profound insights into various aspects of game development, from designing appealing scalable vector graphics and animations to developing advanced collision detection methods. The exciting challenge of dealing with an unfamiliar programming language and learning new technologies made the game a welcome challenge.
Technologien
Tätigkeiten
Pixel Poet
The whole story
- Can an online shop image search be realized reliably using a Large Language Model (LLM) that delivers good product results?
- Can LLM enrich product descriptions based on product images?
- Is the search performant enough?
- What costs can be expected?
We have examined 4 different models. Here are the results:
OpenCLIP image-to-text
- Length of the image description is not sufficient to achieve precise results.
- Image description lacks detail.
- Good for image captions or alt-texts.
- Not suitable for image-based search.
OpenCLIP image-to-image
- Very fast (milliseconds?).
- Not suitable for image-based search.
OpenAI Vision
- Very slow (> 10s).
- Surprisingly good and consistent quality.
- Provides good JSON output.
- Cannot handle bounding boxes =/
Qwen-VL (Alibaba)
- Response times slow: ~ 3-8 seconds.
- Descriptions vary greatly.
- Sometimes detailed - occasionally Chinese characters in the description.
- Sometimes very short and unusable.
- E.g., “black boots on white background”.
- Good results for bounding boxes.
- JSON output possible but not consistent (enough?).
clip-ViT-B-32
- Best image-to-image search outside of OpenAI Vision.
- Few tokens for text-to-image search.
- Good performance.