Hugging Face Inference Endpoints、Jobs 与 Buckets 如何支撑 Papers with Code 搜索
Hugging Face 用 Jobs、Buckets 和 Inference Endpoints 为 Papers with Code 搭建搜索:离线用 Qwen/Qwen3-Embedding-0.6B(固定 revision、256 维 L2 归一化向量)批量生成论文向量,在线仅把查询嵌入放在请求路径上,端点冷启动或异常时立即回退全文检索。5000 篇论文试点中,L4 GPU 上以 1024 维约每秒编码 75 篇,同一批次可确定性降到 512 和 256 维复用。
containing row counts and SHA-256 checksums. We sync that immutable run directory to a private Storage Bucket and mount the Bucket directly (using hf-mount ) into an l4x1 Job (an NVIDIA L4 GPU, which has 24GB of VRAM). From the worker's perspective it is simply a filesystem: hf jobs uv run \ --flavor l4x1 \ -- timeout 6h \ --volume hf://buckets/OWNER/pwc-paper-embeddings:/bucket \ embed papers job.py \ --input /bucket/runs/RUN ID/input \ --output /bucket/runs/RUN ID/output \ --model Qwen/Qwen3-
匹配字段正文

