decodingai-magazine / llm-twin-course

What it does

• Consume messages in real-time from a queue through a Bytewax streaming pipeline.
• Every message will be cleaned, chunked, embedded and loaded into a Qdrant vector DB.
• In the bonus series, we refactor the cleaning, chunking, and embedding logic using Superlinked, a specialized vector compute engine. We will also load and index the vectors to a Redis vector DB.