Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
7moritz7
21 days ago
|
parent
|
context
|
favorite
| on:
Show HN: Use Claude Code to Query 600 GB Indexes o...
The scale. How many tools do you know that can query the
content
of all arxiv papers.
eamag
21 days ago
[–]
Doesn't look like the scale is there, even for HN:
> Currently have embedded: posts: 1.4M / 4.6M comments: 15.6M / 38M That's with Voyage-3.5-lite
Xyra
20 days ago
|
parent
[–]
The scale is there. I'm scraping, cleaning, token efficientizing dozens of sources every single hour. The lack of monies for embedding everything was a temporary problem.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search:
