LlamaIndex 0.9 发布:新增 Ingestion Pipeline 与自动缓存
LlamaIndex 0.9 发布,新增 IngestionPipeline 概念,数据摄取与转换结果会自动缓存,重复运行时可跳过已命中的转换步骤。该版本将节点解析与文本切分接口统一为 TransformComponent,SimpleNodeParser 被移除并重定向到 SentenceSplitter;默认 tokenizer 从 gpt2 改为可配置的 CL100K。LangChain 变为可选依赖,不再默认安装,同时以 beta 形式引入支持 GPT-4V、Llava、Fuyu 的 MultiModal RAG 模块。
options); More predictable and consistent import paths; Plus, in beta: MultiModal RAG Modules for handling text and images! Have questions or concerns? You can report an issue on GitHub or ask a question on our Discord! Read on for more details on our new features and changes. Sometimes, all you want is to ingest and embed nodes from data sources, for instance if your application allows users to upload new data. New in LlamaIndex V0.9 is the concept of an IngestionPipepline . An IngestionPipeli
匹配字段正文


