Canada
I've made a couple of small changes to the scanning process so that scanning speed is increased by an order of magnitude for large directories (~ 500 files). Does anyone know if this will cause a problem with IMDB? Will they notice the extra load and blacklist or lock you out of the site?
If not then the performance can be improved from the current optimized rate of 2-3 seconds per entry to less than a second by pipelining the requests. Having a pipe-line depth of three or four requests should eliminate transmission delay and IMDB query latency.
Rick
If not then the performance can be improved from the current optimized rate of 2-3 seconds per entry to less than a second by pipelining the requests. Having a pipe-line depth of three or four requests should eliminate transmission delay and IMDB query latency.
Rick