Creating a scalable crawler with ConcurrentBag