I want to share a story in a somewhat related topic:
anti web-scraping techniques
The most devious version I ever seen of this, I was baffled, astonished and completely helpless:
This website I was trying to scrap generated a new font (as in a .woff file) on every request, the font had the position of the letters randomly moved around (for example, the 'J' would be in place of the 'F' character in the .woff and so on) and the text produced by the website would be encoded to match that specific font.
So every time you loaded the website you got a completely different font with a completely different text, but for the user the text would look fine because the font mapped it to the original characters. If you tried to copy-and-paste the text from the website you would get some random garbled text.
The only way I could think of to scrap that would have been to OCR the .woff font files, but OCR could easily prevent mass-scraping due to sheer processing costs.
I've been in the VC-backed startup space as a lead/principal engineer or technical advisor for the last 4 years.
In that time, I've worked at 1 startup that closed a $100m C, one that closed a multi-million B, one that recently closed a $30m C, and one that started with a $8m seed.
I've started my own startup and worked with founders of other startups on the side advising on the technical side (and once in a while building the initial PoCs).
Some have failed, some have succeeded wildly, some have hit their limits of growth, some have a great product that solves an obvious problem yet get zero traction.
Here is a lesson-learned as far as "copying" goes: it doesn't matter. It doesn't matter if there are 3 companies in the same domain doing the same thing; then it simply comes down to insider connections, sales, marketing, and pricing.
In the end, the team that wins isn't always the one with the best product; there is a fair bit of luck and timing, marketing is super important, and having the right leadership team in place makes all the difference. The non-product aspects of a successful business are supremely underappreciated, especially by the technical folks. Bad products can become good products eventually; bad teams can rarely survive turbulence and it is so hard to tell if a team has the right "vibes" or not.
So it makes sense for YC or any VC to bet broadly because the reasons why a team succeeds and another fails is so intangible with so much luck and timing involved as well that making broad bets -- even if two YC-batch companies are very similar in terms of domain and product -- is just sound business.
Edit: to be clear, these are not my principles (no need to attack me personally); these are simply my observations about teams that have succeeded and teams that have floundered. I left 1 company because because in principle, I disagreed with their loose operational style in a regulated space.
The comedian Emo Philips has a well-known joke about religion that may explain some of the decline in membership...
"Once I saw this guy on a bridge about to jump. I said, "Don't do it!" He said, "Nobody loves me." I said, "God loves you. Do you believe in God?"
He said, "Yes." I said, "Are you a Christian or a Jew?" He said, "A Christian." I said, "Me, too! Protestant or Catholic?" He said, "Protestant." I said, "Me, too! What franchise?" He said, "Baptist." I said, "Me, too! Northern Baptist or Southern Baptist?" He said, "Northern Baptist." I said, "Me, too! Northern Conservative Baptist or Northern Liberal Baptist?"
He said, "Northern Conservative Baptist." I said, "Me, too! Northern Conservative Baptist Great Lakes Region, or Northern Conservative Baptist Eastern Region?" He said, "Northern Conservative Baptist Great Lakes Region." I said, "Me, too!"
Northern Conservative Baptist Great Lakes Region Council of 1879, or Northern Conservative Baptist Great Lakes Region Council of 1912?" He said, "Northern Conservative Baptist Great Lakes Region Council of 1912." I said, "Die, heretic!" And I pushed him over."
Europe, where the largest business is a luxury handbag company, has now essentially declared acquisitions illegal, and is eagerly regulating American tech companies after completely failing in developing their own tech sector.
anti web-scraping techniques
The most devious version I ever seen of this, I was baffled, astonished and completely helpless:
This website I was trying to scrap generated a new font (as in a .woff file) on every request, the font had the position of the letters randomly moved around (for example, the 'J' would be in place of the 'F' character in the .woff and so on) and the text produced by the website would be encoded to match that specific font.
So every time you loaded the website you got a completely different font with a completely different text, but for the user the text would look fine because the font mapped it to the original characters. If you tried to copy-and-paste the text from the website you would get some random garbled text.
The only way I could think of to scrap that would have been to OCR the .woff font files, but OCR could easily prevent mass-scraping due to sheer processing costs.