Is anyone deploying GraphRAG in prod?
13 points by cbrizz00 12 hours ago | 5 comments
I've been seeing a lot of buzz around GraphRAG and its potential, but many implementations seem to encounter issues, often with Neo4j. Has anyone managed to set up a reliable and cost-effective GraphRAG system in production? I'm curious about real-world experiences and practical solutions.
codekisser 9 hours ago | next |
I develop AI girlfriends. I've struggled a lot with achieving natural-feeling recall. I've gone through a few iterations, but I'm currently experimenting with a knowledge graph/vector hybrid that uses an LLM to extract facts to build the graph. Both the performance and $ cost really hurt, but it truly does breathe life into AI characters. I've seen a lot of the commercial products using the latest and most expensive models in the cloud to extract facts. Instead, I fine-tuned a local model on a gpt4-generated dataset, and it works surprisingly well. It will miss some connections but in practice I don't think it will be too noticeable.