Once you hit a million rows wouldn't it be easier to just make it a proper database? Maybe there are some use cases where this is not true, but I can't imagine what they are.