Using sift on a 100GB txt file still takes multiple minutes. I haven't tried ag,... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		kaiwenwang on Aug 15, 2024 \| parent \| context \| favorite \| on: Inside the "3 billion people" national public data... Using sift on a 100GB txt file still takes multiple minutes. I haven't tried ag, but grep is supposedly slower.

kelnos on Aug 15, 2024 [–]

If the desire is just to grep for your name, email address, whatever, and then throw the rest of the data away, I don't think waiting multiple minutes is a big deal.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact