Reply to thread

Message

<blockquote data-quote="James" data-source="post: 20662" data-attributes="member: 12681">Hi Taipan,Description and genre should be supported. However, current I have not put in support for rating.For yahoo all this extra data is contained on a linked page. So you must enable this option in the config and set a time between which you want linked pages. (0 to 23 is the whole day) The default is currently set to 18 to 23, or prime time. This is to cut down the requests on the sites for information that may not be used / required. I was also thinking of feathure to have a list of strings (like &quot;friends&quot; etc) that could be matched with the title to then grab the linked page.However, there seems to be something at yahoo the blocks a number of requests for linked pages and block the IP address for a certain time. At first it seemed to be time based if the request came to quickly. So I set a delay of 5seconds between these grabs. This seemed to fix the problem for my test with 1 channel and a few days. However, it seems to have another limit. Maybe set of the total number of pages loaded.What would be really good. If you can find out want they are doing here. What the limit is. How long the IP is blocked for, etc. If possible any way to get around the limit. I was thinking of testing with different browser string (program, OS, etc). So that it hopefully thinks that different computers behind a NAT firewall with the same IP are accesses the site?Any information on this would help.Cheers,/James</blockquote>

[QUOTE="James, post: 20662, member: 12681"] Hi Taipan, Description and genre should be supported. However, current I have not put in support for rating. For yahoo all this extra data is contained on a linked page. So you must enable this option in the config and set a time between which you want linked pages. (0 to 23 is the whole day) The default is currently set to 18 to 23, or prime time. This is to cut down the requests on the sites for information that may not be used / required. I was also thinking of feathure to have a list of strings (like "friends" etc) that could be matched with the title to then grab the linked page. However, there seems to be something at yahoo the blocks a number of requests for linked pages and block the IP address for a certain time. At first it seemed to be time based if the request came to quickly. So I set a delay of 5seconds between these grabs. This seemed to fix the problem for my test with 1 channel and a few days. However, it seems to have another limit. Maybe set of the total number of pages loaded. What would be really good. If you can find out want they are doing here. What the limit is. How long the IP is blocked for, etc. If possible any way to get around the limit. I was thinking of testing with different browser string (program, OS, etc). So that it hopefully thinks that different computers behind a NAT firewall with the same IP are accesses the site? Any information on this would help. Cheers, /James [/QUOTE]

Verification