Reply to thread

Message

<blockquote data-quote="ltfearme" data-source="post: 1263604" data-attributes="member: 52219">Quick update, I added some code to handle redirects, but it looks like the secure updates url tries to redirect again but with no Location header.[code]&nbsp; &nbsp; &nbsp; string newUrl = null;&nbsp; &nbsp; &nbsp; HttpWebRequest request = null;&nbsp; &nbsp; &nbsp; HttpWebResponse response = null;&nbsp; &nbsp; &nbsp; try&nbsp; &nbsp; &nbsp; {&nbsp; &nbsp; &nbsp; &nbsp; // .NET 4.0: Use TLS v1.2. Many download sources no longer support the older and now insecure TLS v1.0/1.1 and SSL v3.&nbsp; &nbsp; &nbsp; &nbsp; ServicePointManager.SecurityProtocol = ( SecurityProtocolType )0xc00;&nbsp; &nbsp; &nbsp; &nbsp; request = (HttpWebRequest)WebRequest.Create(sUrl);&nbsp; &nbsp; &nbsp; &nbsp; // Note: some network proxies require the useragent string to be set or they will deny the http request&nbsp; &nbsp; &nbsp; &nbsp; // this is true for instance for EVERY thailand internet connection (also needs to be set for banners/episodethumbs and any other http request we send)&nbsp; &nbsp; &nbsp; &nbsp; request.UserAgent = Settings.UserAgent;&nbsp; &nbsp; &nbsp; &nbsp; request.Timeout = 60000;&nbsp; &nbsp; &nbsp; &nbsp; // turn off auto-redirection on the initial request.&nbsp; &nbsp; &nbsp; &nbsp; // then we can pull out the header and do the redirection manually by making a new request.&nbsp; &nbsp; &nbsp; &nbsp; request.AllowAutoRedirect = false;&nbsp; &nbsp; &nbsp; &nbsp; response = (HttpWebResponse)request.GetResponse();&nbsp; &nbsp; &nbsp; &nbsp; MPTVSeriesLog.Write( $&quot;Status Code={ response.StatusCode }, Headers={ response.Headers }&quot;, MPTVSeriesLog.LogLevel.Debug );&nbsp; &nbsp; &nbsp; &nbsp; // check for redirect&nbsp; &nbsp; &nbsp; &nbsp; switch ( response.StatusCode )&nbsp; &nbsp; &nbsp; &nbsp; {&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; case HttpStatusCode.Redirect:&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; case HttpStatusCode.MovedPermanently:&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; case HttpStatusCode.RedirectKeepVerb:&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; case HttpStatusCode.RedirectMethod:&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; newUrl = response.Headers[&quot;Location&quot;];&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; if ( newUrl == null )&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; return null;&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; if ( newUrl.IndexOf( &quot;://&quot;, System.StringComparison.Ordinal ) == -1 )&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; {&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; // doesn't have a URL Schema, meaning it's a relative or absolute URL&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; var u = new Uri( new Uri( sUrl ), newUrl );&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; newUrl = u.ToString();&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; }&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; // now re-request using new url&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; return RetrieveData( newUrl );&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; break;&nbsp; &nbsp; &nbsp; &nbsp; }&nbsp; &nbsp;&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; if (response != null) // Get the stream associated with the response.&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; return response.GetResponseStream();&nbsp; &nbsp; &nbsp; }[/code]Does anyone know why that is? Known issue?The request headers returns:[code]2019-11-21 16:41:30.371 [DEBG][05]: Retrieving Data from: https://thetvdb.com/api/&lt;apikey&gt;/updates/updates_month.zip2019-11-21 16:41:30.475 [DEBG][05]: Status Code='Redirect', Headers=Connection: keep-alivex-amzn-RequestId: d399016c-1663-442e-b65c-4e81e0529262x-amz-apigw-id: DeqTcH6HvHcFRFw=X-Amzn-Trace-Id: Root=1-5dd5bdaf-e52331d2b04543ae92f8ec6e;Sampled=0X-Amz-Cf-Pop: SIN52-C2,SIN52-C2X-Cache: Hit from cloudfrontX-Amz-Cf-Id: 3sj8ouyPvxLlCMmXo0lCMuP1LYUFc3ynpoNK78UVfvkA0jg5u3ptfg==Age: 7817Content-Length: 64Content-Type: application/jsonDate: Wed, 20 Nov 2019 22:26:55 GMTVia: 1.1 21091692796ba0a5be0a5b521f44889c.cloudfront.net (CloudFront), 1.1 6b0d2463e38d8b2224f25b309fde2ba3.cloudfront.net (CloudFront)[/code]</blockquote>

[QUOTE="ltfearme, post: 1263604, member: 52219"] Quick update, I added some code to handle redirects, but it looks like the secure updates url tries to redirect again but with no Location header. [code] string newUrl = null; HttpWebRequest request = null; HttpWebResponse response = null; try { // .NET 4.0: Use TLS v1.2. Many download sources no longer support the older and now insecure TLS v1.0/1.1 and SSL v3. ServicePointManager.SecurityProtocol = ( SecurityProtocolType )0xc00; request = (HttpWebRequest)WebRequest.Create(sUrl); // Note: some network proxies require the useragent string to be set or they will deny the http request // this is true for instance for EVERY thailand internet connection (also needs to be set for banners/episodethumbs and any other http request we send) request.UserAgent = Settings.UserAgent; request.Timeout = 60000; // turn off auto-redirection on the initial request. // then we can pull out the header and do the redirection manually by making a new request. request.AllowAutoRedirect = false; response = (HttpWebResponse)request.GetResponse(); MPTVSeriesLog.Write( $"Status Code={ response.StatusCode }, Headers={ response.Headers }", MPTVSeriesLog.LogLevel.Debug ); // check for redirect switch ( response.StatusCode ) { case HttpStatusCode.Redirect: case HttpStatusCode.MovedPermanently: case HttpStatusCode.RedirectKeepVerb: case HttpStatusCode.RedirectMethod: newUrl = response.Headers["Location"]; if ( newUrl == null ) return null; if ( newUrl.IndexOf( "://", System.StringComparison.Ordinal ) == -1 ) { // doesn't have a URL Schema, meaning it's a relative or absolute URL var u = new Uri( new Uri( sUrl ), newUrl ); newUrl = u.ToString(); } // now re-request using new url return RetrieveData( newUrl ); break; } if (response != null) // Get the stream associated with the response. return response.GetResponseStream(); } [/code] Does anyone know why that is? Known issue? The request headers returns: [code] 2019-11-21 16:41:30.371 [DEBG][05]: Retrieving Data from: https://thetvdb.com/api/<apikey>/updates/updates_month.zip 2019-11-21 16:41:30.475 [DEBG][05]: Status Code='Redirect', Headers=Connection: keep-alive x-amzn-RequestId: d399016c-1663-442e-b65c-4e81e0529262 x-amz-apigw-id: DeqTcH6HvHcFRFw= X-Amzn-Trace-Id: Root=1-5dd5bdaf-e52331d2b04543ae92f8ec6e;Sampled=0 X-Amz-Cf-Pop: SIN52-C2,SIN52-C2 X-Cache: Hit from cloudfront X-Amz-Cf-Id: 3sj8ouyPvxLlCMmXo0lCMuP1LYUFc3ynpoNK78UVfvkA0jg5u3ptfg== Age: 7817 Content-Length: 64 Content-Type: application/json Date: Wed, 20 Nov 2019 22:26:55 GMT Via: 1.1 21091692796ba0a5be0a5b521f44889c.cloudfront.net (CloudFront), 1.1 6b0d2463e38d8b2224f25b309fde2ba3.cloudfront.net (CloudFront) [/code] [/QUOTE]

Verification