2020-04-12 21:01:33 INFO Log opened. 2020-04-12 21:01:34 INFO [stdout] Comecou spider 1 PS4 2020-04-12 21:01:34 DEBUG [oauth2client.crypt] [b'eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6ImUyYTkyZGY2ZDIyZTAzYjRlYmVmZDUzOGY1MDMzNDM4OTljMDM4NzQifQ', b'eyJhdWQiOiJodHRwczovL29hdXRoMi5nb29nbGVhcGlzLmNvbS90b2tlbiIsInNjb3BlIjoiaHR0cHM6Ly9zcHJlYWRzaGVldHMuZ29vZ2xlLmNvbS9mZWVkcyBodHRwczovL3d3dy5nb29nbGVhcGlzLmNvbS9hdXRoL2RyaXZlIiwiaWF0IjoxNTg2NzI1Mjk0LCJleHAiOjE1ODY3Mjg4OTQsImlzcyI6InB5dGhvbnNwc2l0ZUBweXRob25zcHJlYWRzaGVldHNpdGUuaWFtLmdzZXJ2aWNlYWNjb3VudC5jb20ifQ', b'uZyX6tFxHmIlLNVhfF1dZSoUQajRkfinVj_rkS1Mex7hdFn1NIQ9KyEfUEi-M_IzG0unx0hyVE10ozSCCbWA4MQcuQXcTMFVHsPs0fwIGh6vH4fSgu81dDLhjcsLBQLRkr4SAgiv3dmFLPBrFq0Kwe0Rq5ZTYU_FUjKCkVXz66460y7eMY5ZPF6qxSyexETIywpvv-DFLE1BkVJ8_CBJFIPITtTWNGmr11Ruv6SGwH_wMZtaoDYOKF4Lv_L5HyjyQ46BYi6ME5dEggI3Yb2AfF8_a3bPkl2b9x6otQfFidqOHfvmNIiVBZN7NGJmywffWKD4cxNmNiEVGZMhwbL-9g'] 2020-04-12 21:01:34 INFO [oauth2client.client] Refreshing access_token 2020-04-12 21:01:34 DEBUG [urllib3.connectionpool] Starting new HTTPS connection (1): www.googleapis.com:443 2020-04-12 21:01:34 DEBUG [urllib3.connectionpool] https://www.googleapis.com:443 "GET /drive/v3/files?q=mimeType%3D%27application%2Fvnd.google-apps.spreadsheet%27&pageSize=1000&supportsTeamDrives=True&includeTeamDriveItems=True HTTP/1.1" 200 None 2020-04-12 21:01:34 DEBUG [urllib3.connectionpool] Starting new HTTPS connection (1): sheets.googleapis.com:443 2020-04-12 21:01:35 DEBUG [urllib3.connectionpool] https://sheets.googleapis.com:443 "GET /v4/spreadsheets/1uGjUqaUNk9hdD45uIUqpx8wkRRVRU9nf9NPIZKO7JG8?includeGridData=false HTTP/1.1" 200 None 2020-04-12 21:01:35 DEBUG [urllib3.connectionpool] https://sheets.googleapis.com:443 "GET /v4/spreadsheets/1uGjUqaUNk9hdD45uIUqpx8wkRRVRU9nf9NPIZKO7JG8/values/UpdatePS42%21Z2%3AZ28 HTTP/1.1" 200 None 2020-04-12 21:01:35 INFO [stdout] Comecou spider 1 Xbox 2020-04-12 21:01:35 DEBUG [oauth2client.crypt] [b'eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6ImUyYTkyZGY2ZDIyZTAzYjRlYmVmZDUzOGY1MDMzNDM4OTljMDM4NzQifQ', b'eyJhdWQiOiJodHRwczovL29hdXRoMi5nb29nbGVhcGlzLmNvbS90b2tlbiIsInNjb3BlIjoiaHR0cHM6Ly9zcHJlYWRzaGVldHMuZ29vZ2xlLmNvbS9mZWVkcyBodHRwczovL3d3dy5nb29nbGVhcGlzLmNvbS9hdXRoL2RyaXZlIiwiaWF0IjoxNTg2NzI1Mjk1LCJleHAiOjE1ODY3Mjg4OTUsImlzcyI6InB5dGhvbnNwc2l0ZUBweXRob25zcHJlYWRzaGVldHNpdGUuaWFtLmdzZXJ2aWNlYWNjb3VudC5jb20ifQ', b'sOIlFOQmEPjU2RVUBspmf_NGmvlrotocvXILyubBmCtjgAoDnbAxw6dor80rnoRv015ZH7bCBalsjLEO2HHFUj3w_sDb7tjfTE2AYpb4p3fZWm9tG79umATe05On_RMVJsXZg71vuVvYPpwTMWBVDdTTs5-gnOgDzhVb-q0tDWIYWTWRgC7FQzE5qSljGrPi6M0LR8r-MrB9HvS6ME3biInWPY6GyOLBlheI3Fwo7dnTj9dJPVqI4-dDFacLhp1CwLgVPwy2shpeAH5cg28NpDAldMf8ilR51DyeiKyaoYHlnANQjnMJ6kki2SfzTMQYbaLsX3yHAS41E2St6dW5CA'] 2020-04-12 21:01:35 INFO [oauth2client.client] Refreshing access_token 2020-04-12 21:01:35 DEBUG [urllib3.connectionpool] Starting new HTTPS connection (1): www.googleapis.com:443 2020-04-12 21:01:36 DEBUG [urllib3.connectionpool] https://www.googleapis.com:443 "GET /drive/v3/files?q=mimeType%3D%27application%2Fvnd.google-apps.spreadsheet%27&pageSize=1000&supportsTeamDrives=True&includeTeamDriveItems=True HTTP/1.1" 200 None 2020-04-12 21:01:36 DEBUG [urllib3.connectionpool] Starting new HTTPS connection (1): sheets.googleapis.com:443 2020-04-12 21:01:36 DEBUG [urllib3.connectionpool] https://sheets.googleapis.com:443 "GET /v4/spreadsheets/1uGjUqaUNk9hdD45uIUqpx8wkRRVRU9nf9NPIZKO7JG8?includeGridData=false HTTP/1.1" 200 None 2020-04-12 21:01:36 DEBUG [urllib3.connectionpool] https://sheets.googleapis.com:443 "GET /v4/spreadsheets/1uGjUqaUNk9hdD45uIUqpx8wkRRVRU9nf9NPIZKO7JG8/values/UpdateXBOX2%21Z2%3AZ28 HTTP/1.1" 200 None 2020-04-12 21:01:36 DEBUG [oauth2client.crypt] [b'eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6ImUyYTkyZGY2ZDIyZTAzYjRlYmVmZDUzOGY1MDMzNDM4OTljMDM4NzQifQ', b'eyJhdWQiOiJodHRwczovL29hdXRoMi5nb29nbGVhcGlzLmNvbS90b2tlbiIsInNjb3BlIjoiaHR0cHM6Ly9zcHJlYWRzaGVldHMuZ29vZ2xlLmNvbS9mZWVkcyBodHRwczovL3d3dy5nb29nbGVhcGlzLmNvbS9hdXRoL2RyaXZlIiwiaWF0IjoxNTg2NzI1Mjk2LCJleHAiOjE1ODY3Mjg4OTYsImlzcyI6InB5dGhvbnNwc2l0ZUBweXRob25zcHJlYWRzaGVldHNpdGUuaWFtLmdzZXJ2aWNlYWNjb3VudC5jb20ifQ', b'hwLHJViVT_4LiFGW2h12fp92vEAZJwiRW-EbYI2v4ZPabUonsGuL5-Z3j5_qVELUjbSFF4KXv_5yLehjgFAoNzb58WbNVrLpU5zCeQNolvSjyOSKDjT7ng2_0_QiNS_iFWNKmCN7UT9np9y-RhP-7ibOdziyrqsmCDhBcEVv41jm7K21sdvPMxmmCE0h4RrlPmToQOJpRY2PYRG3TSj2AinbXl9oG_fXyVQMWzaqDkAusNaOE3EDTaTwR5TpQOMfNiFiUBHdzhmGIL7V11GmUZeNTp39j14AYtC9pOnc4XdiDRHcNT0RTwqP__howjC3oZMoXkxxQgtjoFYmfA6XKw'] 2020-04-12 21:01:36 INFO [oauth2client.client] Refreshing access_token 2020-04-12 21:01:36 DEBUG [urllib3.connectionpool] Starting new HTTPS connection (1): www.googleapis.com:443 2020-04-12 21:01:37 DEBUG [urllib3.connectionpool] https://www.googleapis.com:443 "GET /drive/v3/files?q=mimeType%3D%27application%2Fvnd.google-apps.spreadsheet%27&pageSize=1000&supportsTeamDrives=True&includeTeamDriveItems=True HTTP/1.1" 200 None 2020-04-12 21:01:37 DEBUG [urllib3.connectionpool] Starting new HTTPS connection (1): sheets.googleapis.com:443 2020-04-12 21:01:37 DEBUG [urllib3.connectionpool] https://sheets.googleapis.com:443 "GET /v4/spreadsheets/1uGjUqaUNk9hdD45uIUqpx8wkRRVRU9nf9NPIZKO7JG8?includeGridData=false HTTP/1.1" 200 None 2020-04-12 21:01:37 DEBUG [urllib3.connectionpool] https://sheets.googleapis.com:443 "GET /v4/spreadsheets/1uGjUqaUNk9hdD45uIUqpx8wkRRVRU9nf9NPIZKO7JG8/values/ConfigsZoomPS4%21E32%3AE59 HTTP/1.1" 200 None 2020-04-12 21:01:37 INFO [stdout] ['https://www.zoom.com.br/search?q=jogo+Naruto+To+Boruto+Shinobi+Striker+PS4', '', 'https://www.zoom.com.br/search?q=jogo+The+Witcher+3+Wild+Hunt+Ed+Completa+PS4', 'https://www.zoom.com.br/search?q=jogo+Dragon+Ball+Z+Kakarot+PS4+', 'https://www.zoom.com.br/search?q=jogo+', 'https://www.zoom.com.br/search?q=jogo+Batman+Arkham+Knight+PS4', 'https://www.zoom.com.br/search?q=jogo+The+Last+Of+Us+II+PS4', '', 'https://www.zoom.com.br/search?q=jogo+Dead+by+Daylight+Edição+Especial+PS4', '', '', '', '', '', '', '', 'https://www.zoom.com.br/search?q=jogo+Ghostbusters+PS4', '', '', 'https://www.zoom.com.br/search?q=jogo+The+Elder+Scrolls+Online+Morrowind+PS4', 'https://www.zoom.com.br/search?q=jogo+Dragon+Age+Inquisition+PS4', '', '', '', '', '', '', ''] 2020-04-12 21:01:37 INFO [stdout] ['https://www.zoom.com.br/search?q=jogo+Naruto+To+Boruto+Shinobi+Striker+PS4', '', 'https://www.zoom.com.br/search?q=jogo+The+Witcher+3+Wild+Hunt+Ed+Completa+PS4', 'https://www.zoom.com.br/search?q=jogo+Dragon+Ball+Z+Kakarot+PS4+', 'https://www.zoom.com.br/search?q=jogo+', 'https://www.zoom.com.br/search?q=jogo+Batman+Arkham+Knight+PS4', 'https://www.zoom.com.br/search?q=jogo+The+Last+Of+Us+II+PS4', '', 'https://www.zoom.com.br/search?q=jogo+Dead+by+Daylight+Edição+Especial+PS4', '', '', '', '', '', '', '', 'https://www.zoom.com.br/search?q=jogo+Ghostbusters+PS4', '', '', 'https://www.zoom.com.br/search?q=jogo+The+Elder+Scrolls+Online+Morrowind+PS4', 'https://www.zoom.com.br/search?q=jogo+Dragon+Age+Inquisition+PS4', '', '', '', '', '', '', ''] 2020-04-12 21:01:37 DEBUG [oauth2client.crypt] [b'eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6ImUyYTkyZGY2ZDIyZTAzYjRlYmVmZDUzOGY1MDMzNDM4OTljMDM4NzQifQ', b'eyJhdWQiOiJodHRwczovL29hdXRoMi5nb29nbGVhcGlzLmNvbS90b2tlbiIsInNjb3BlIjoiaHR0cHM6Ly9zcHJlYWRzaGVldHMuZ29vZ2xlLmNvbS9mZWVkcyBodHRwczovL3d3dy5nb29nbGVhcGlzLmNvbS9hdXRoL2RyaXZlIiwiaWF0IjoxNTg2NzI1Mjk3LCJleHAiOjE1ODY3Mjg4OTcsImlzcyI6InB5dGhvbnNwc2l0ZUBweXRob25zcHJlYWRzaGVldHNpdGUuaWFtLmdzZXJ2aWNlYWNjb3VudC5jb20ifQ', b'PqbjirE3ZMPKR6vhcsUVw79F_fX8shCHaDLyEn41W1r1Fgq_F3dECvxuqbjGfpVbM2RA2jLKYv3UyZ0GcDSM4Hv6mEQ6h5V-ueSf2gFOtF48XDH6uaB_JanX9nYPyeeZwyPhWBttO_A1ScAVuErFIQqFGmD8vZEeWpw9VtmAUIrVRJya4BUUQ3V8LklR7EEHwX0vBGIpVF2KcEgmnxbeSQCicbjX-LnhWz21VLzXWZpvJnmxdbzQUhvfhZj9KXTC1G-tkRkHXulFE70mO2SNPUrPG9SMLahVIAKzF0iE3zymyVHveB3y_EfmCa0_067rFbr-C1oRmOy69rxD4Hc9gA'] 2020-04-12 21:01:37 INFO [oauth2client.client] Refreshing access_token 2020-04-12 21:01:37 DEBUG [urllib3.connectionpool] Starting new HTTPS connection (1): www.googleapis.com:443 2020-04-12 21:01:37 DEBUG [urllib3.connectionpool] https://www.googleapis.com:443 "GET /drive/v3/files?q=mimeType%3D%27application%2Fvnd.google-apps.spreadsheet%27&pageSize=1000&supportsTeamDrives=True&includeTeamDriveItems=True HTTP/1.1" 200 None 2020-04-12 21:01:37 DEBUG [urllib3.connectionpool] Starting new HTTPS connection (1): sheets.googleapis.com:443 2020-04-12 21:01:38 DEBUG [urllib3.connectionpool] https://sheets.googleapis.com:443 "GET /v4/spreadsheets/1uGjUqaUNk9hdD45uIUqpx8wkRRVRU9nf9NPIZKO7JG8?includeGridData=false HTTP/1.1" 200 None 2020-04-12 21:01:38 DEBUG [urllib3.connectionpool] https://sheets.googleapis.com:443 "GET /v4/spreadsheets/1uGjUqaUNk9hdD45uIUqpx8wkRRVRU9nf9NPIZKO7JG8/values/ConfigsAPIXBOX%21E32%3AE59 HTTP/1.1" 200 None 2020-04-12 21:01:38 INFO [stdout] ['https://www.zoom.com.br/search?q=jogo+HITMAN+2+Xbox+One', 'https://www.zoom.com.br/search?q=jogo+Star+Wars+Jedi+Fallen+Order+Xbox+One', 'https://www.zoom.com.br/search?q=jogo+Ghost+Recon+Breakpoint+para+Xbox+One++Ubisoft', '', '', '', '', 'https://www.zoom.com.br/search?q=jogo+Minecraft+Xbox+One', '', '', '', '', 'https://www.zoom.com.br/search?q=jogo+Resident+Evil+2+Xbox+One', 'https://www.zoom.com.br/search?q=jogo+Rocket+League+Xbox+One', 'https://www.zoom.com.br/search?q=jogo+SOULCALIBUR+VI+Xbox+One', '', '', 'https://www.zoom.com.br/search?q=jogo+The+Sims+4+Xbox+One', '', '', '', '', '', '', '', '', '', ''] 2020-04-12 21:01:38 INFO [stdout] ['https://www.zoom.com.br/search?q=jogo+HITMAN+2+Xbox+One', 'https://www.zoom.com.br/search?q=jogo+Star+Wars+Jedi+Fallen+Order+Xbox+One', 'https://www.zoom.com.br/search?q=jogo+Ghost+Recon+Breakpoint+para+Xbox+One++Ubisoft', '', '', '', '', 'https://www.zoom.com.br/search?q=jogo+Minecraft+Xbox+One', '', '', '', '', 'https://www.zoom.com.br/search?q=jogo+Resident+Evil+2+Xbox+One', 'https://www.zoom.com.br/search?q=jogo+Rocket+League+Xbox+One', 'https://www.zoom.com.br/search?q=jogo+SOULCALIBUR+VI+Xbox+One', '', '', 'https://www.zoom.com.br/search?q=jogo+The+Sims+4+Xbox+One', '', '', '', '', '', '', '', '', '', ''] 2020-04-12 21:01:38 INFO [scrapy.utils.log] Scrapy 2.0.0 started (bot: bin) 2020-04-12 21:01:38 INFO [stderr] 2020-04-12 21:01:38 [scrapy.utils.log] INFO: Scrapy 2.0.0 started (bot: bin) 2020-04-12 21:01:38 INFO [scrapy.utils.log] Versions: lxml 4.5.0.0, libxml2 2.9.10, cssselect 1.1.0, parsel 1.5.2, w3lib 1.21.0, Twisted 19.10.0, Python 3.8.2 (default, Feb 26 2020, 15:09:34) - [GCC 8.3.0], pyOpenSSL 19.1.0 (OpenSSL 1.1.1d 10 Sep 2019), cryptography 2.8, Platform Linux-4.15.0-74-generic-x86_64-with-glibc2.2.5 2020-04-12 21:01:38 INFO [stderr] 2020-04-12 21:01:38 [scrapy.utils.log] INFO: Versions: lxml 4.5.0.0, libxml2 2.9.10, cssselect 1.1.0, parsel 1.5.2, w3lib 1.21.0, Twisted 19.10.0, Python 3.8.2 (default, Feb 26 2020, 15:09:34) - [GCC 8.3.0], pyOpenSSL 19.1.0 (OpenSSL 1.1.1d 10 Sep 2019), cryptography 2.8, Platform Linux-4.15.0-74-generic-x86_64-with-glibc2.2.5 2020-04-12 21:01:38 DEBUG [scrapy.utils.log] Using reactor: twisted.internet.epollreactor.EPollReactor 2020-04-12 21:01:38 INFO [stderr] 2020-04-12 21:01:38 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.epollreactor.EPollReactor 2020-04-12 21:01:38 INFO [scrapy.crawler] Overridden settings: {'BOT_NAME': 'bin', 'NEWSPIDER_MODULE': 'bin.spiders', 'SPIDER_MODULES': ['bin.spiders'], 'USER_AGENT': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_1) ' 'AppleWebKit/537.36 (KHTML, like Gecko) Chrome/41.0.2227.1 ' 'Safari/537.36'} 2020-04-12 21:01:38 INFO [stderr] 2020-04-12 21:01:38 [scrapy.crawler] INFO: Overridden settings: 2020-04-12 21:01:38 INFO [stderr] {'BOT_NAME': 'bin', 2020-04-12 21:01:38 INFO [stderr] 'NEWSPIDER_MODULE': 'bin.spiders', 2020-04-12 21:01:38 INFO [stderr] 'SPIDER_MODULES': ['bin.spiders'], 2020-04-12 21:01:38 INFO [stderr] 'USER_AGENT': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_1) ' 2020-04-12 21:01:38 INFO [stderr] 'AppleWebKit/537.36 (KHTML, like Gecko) Chrome/41.0.2227.1 ' 2020-04-12 21:01:38 INFO [stderr] 'Safari/537.36'} 2020-04-12 21:01:38 INFO [scrapy.extensions.telnet] Telnet Password: adef615116d03e2d 2020-04-12 21:01:38 INFO [stderr] 2020-04-12 21:01:38 [scrapy.extensions.telnet] INFO: Telnet Password: adef615116d03e2d 2020-04-12 21:01:38 INFO [scrapy.middleware] Enabled extensions: ['scrapy.extensions.corestats.CoreStats', 'scrapy.extensions.telnet.TelnetConsole', 'scrapy.extensions.memusage.MemoryUsage', 'scrapy.extensions.logstats.LogStats'] 2020-04-12 21:01:38 INFO [stderr] 2020-04-12 21:01:38 [scrapy.middleware] INFO: Enabled extensions: 2020-04-12 21:01:38 INFO [stderr] ['scrapy.extensions.corestats.CoreStats', 2020-04-12 21:01:38 INFO [stderr] 'scrapy.extensions.telnet.TelnetConsole', 2020-04-12 21:01:38 INFO [stderr] 'scrapy.extensions.memusage.MemoryUsage', 2020-04-12 21:01:38 INFO [stderr] 'scrapy.extensions.logstats.LogStats'] 2020-04-12 21:01:38 INFO [scrapy.middleware] Enabled downloader middlewares: ['scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware', 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware', 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware', 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware', 'bin.middlewares.UserAgentMiddleware', 'scrapy.downloadermiddlewares.retry.RetryMiddleware', 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware', 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware', 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware', 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware', 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware', 'scrapy.downloadermiddlewares.stats.DownloaderStats'] 2020-04-12 21:01:38 INFO [stderr] 2020-04-12 21:01:38 [scrapy.middleware] INFO: Enabled downloader middlewares: 2020-04-12 21:01:38 INFO [stderr] ['scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware', 2020-04-12 21:01:38 INFO [stderr] 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware', 2020-04-12 21:01:38 INFO [stderr] 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware', 2020-04-12 21:01:38 INFO [stderr] 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware', 2020-04-12 21:01:38 INFO [stderr] 'bin.middlewares.UserAgentMiddleware', 2020-04-12 21:01:38 INFO [stderr] 'scrapy.downloadermiddlewares.retry.RetryMiddleware', 2020-04-12 21:01:38 INFO [stderr] 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware', 2020-04-12 21:01:38 INFO [stderr] 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware', 2020-04-12 21:01:38 INFO [stderr] 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware', 2020-04-12 21:01:38 INFO [stderr] 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware', 2020-04-12 21:01:38 INFO [stderr] 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware', 2020-04-12 21:01:38 INFO [stderr] 'scrapy.downloadermiddlewares.stats.DownloaderStats'] 2020-04-12 21:01:38 INFO [scrapy.middleware] Enabled spider middlewares: ['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware', 'scrapy.spidermiddlewares.offsite.OffsiteMiddleware', 'scrapy.spidermiddlewares.referer.RefererMiddleware', 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware', 'scrapy.spidermiddlewares.depth.DepthMiddleware'] 2020-04-12 21:01:38 INFO [stderr] 2020-04-12 21:01:38 [scrapy.middleware] INFO: Enabled spider middlewares: 2020-04-12 21:01:38 INFO [stderr] ['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware', 2020-04-12 21:01:38 INFO [stderr] 'scrapy.spidermiddlewares.offsite.OffsiteMiddleware', 2020-04-12 21:01:38 INFO [stderr] 'scrapy.spidermiddlewares.referer.RefererMiddleware', 2020-04-12 21:01:38 INFO [stderr] 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware', 2020-04-12 21:01:38 INFO [stderr] 'scrapy.spidermiddlewares.depth.DepthMiddleware'] 2020-04-12 21:01:38 INFO [scrapy.middleware] Enabled item pipelines: [] 2020-04-12 21:01:38 INFO [stderr] 2020-04-12 21:01:38 [scrapy.middleware] INFO: Enabled item pipelines: 2020-04-12 21:01:38 INFO [stderr] [] 2020-04-12 21:01:38 INFO [scrapy.core.engine] Spider opened 2020-04-12 21:01:38 INFO [stderr] 2020-04-12 21:01:38 [scrapy.core.engine] INFO: Spider opened 2020-04-12 21:01:38 INFO [scrapy.extensions.logstats] Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2020-04-12 21:01:38 INFO [stderr] 2020-04-12 21:01:38 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2020-04-12 21:01:38 INFO TelnetConsole starting on 6023 2020-04-12 21:01:38 INFO [scrapy.extensions.telnet] Telnet console listening on 127.0.0.1:6023 2020-04-12 21:01:38 INFO [stderr] 2020-04-12 21:01:38 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023 2020-04-12 21:01:39 DEBUG [scrapy.dupefilters] Filtered duplicate request: - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates) 2020-04-12 21:01:39 INFO [stderr] 2020-04-12 21:01:39 [scrapy.dupefilters] DEBUG: Filtered duplicate request: - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates) 2020-04-12 21:01:39 DEBUG [scrapy.downloadermiddlewares.redirect] Redirecting (307) to from 2020-04-12 21:01:39 INFO [stderr] 2020-04-12 21:01:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (307) to from 2020-04-12 21:01:39 DEBUG [scrapy.downloadermiddlewares.redirect] Redirecting (307) to from 2020-04-12 21:01:39 INFO [stderr] 2020-04-12 21:01:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (307) to from 2020-04-12 21:01:39 DEBUG [scrapy.downloadermiddlewares.redirect] Redirecting (302) to from 2020-04-12 21:01:39 INFO [stderr] 2020-04-12 21:01:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to from 2020-04-12 21:01:39 DEBUG [scrapy.core.engine] Crawled (200) (referer: None) 2020-04-12 21:01:39 INFO [stderr] 2020-04-12 21:01:39 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2020-04-12 21:01:39 DEBUG [scrapy.core.engine] Crawled (200) (referer: None) 2020-04-12 21:01:39 INFO [stderr] 2020-04-12 21:01:39 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2020-04-12 21:01:39 DEBUG [scrapy.core.engine] Crawled (200) (referer: None) 2020-04-12 21:01:39 INFO [stderr] 2020-04-12 21:01:39 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2020-04-12 21:01:39 DEBUG [scrapy.core.engine] Crawled (200) (referer: None) 2020-04-12 21:01:39 INFO [stderr] 2020-04-12 21:01:39 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2020-04-12 21:01:39 DEBUG [scrapy.core.engine] Crawled (200) (referer: None) 2020-04-12 21:01:39 INFO [stderr] 2020-04-12 21:01:39 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2020-04-12 21:01:39 DEBUG [scrapy.core.engine] Crawled (200) (referer: None) 2020-04-12 21:01:39 INFO [stderr] 2020-04-12 21:01:39 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2020-04-12 21:01:39 DEBUG [scrapy.downloadermiddlewares.redirect] Redirecting (302) to from 2020-04-12 21:01:39 INFO [stderr] 2020-04-12 21:01:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to from 2020-04-12 21:01:39 DEBUG [scrapy.core.engine] Crawled (200) (referer: None) 2020-04-12 21:01:39 INFO [stderr] 2020-04-12 21:01:39 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2020-04-12 21:01:39 DEBUG [scrapy.core.scraper] Scraped from <200 http://www.pudim.com.br/> {'index': 4, 'preco': ''} 2020-04-12 21:01:39 INFO [stderr] 2020-04-12 21:01:39 [scrapy.core.scraper] DEBUG: Scraped from <200 http://www.pudim.com.br/> 2020-04-12 21:01:39 INFO [stderr] {'index': 4, 'preco': ''} 2020-04-12 21:01:39 DEBUG [scrapy.core.scraper] Scraped from <200 http://www.pudim.com.br/> {'index': 7, 'preco': ''} 2020-04-12 21:01:39 INFO [stderr] 2020-04-12 21:01:39 [scrapy.core.scraper] DEBUG: Scraped from <200 http://www.pudim.com.br/> 2020-04-12 21:01:39 INFO [stderr] {'index': 7, 'preco': ''} 2020-04-12 21:01:39 DEBUG [scrapy.core.scraper] Scraped from <200 http://www.pudim.com.br/> {'index': 14, 'preco': ''} 2020-04-12 21:01:39 INFO [stderr] 2020-04-12 21:01:39 [scrapy.core.scraper] DEBUG: Scraped from <200 http://www.pudim.com.br/> 2020-04-12 21:01:39 INFO [stderr] {'index': 14, 'preco': ''} 2020-04-12 21:01:39 DEBUG [scrapy.core.scraper] Scraped from <200 http://www.pudim.com.br/> {'index': 13, 'preco': ''} 2020-04-12 21:01:39 INFO [stderr] 2020-04-12 21:01:39 [scrapy.core.scraper] DEBUG: Scraped from <200 http://www.pudim.com.br/> 2020-04-12 21:01:39 INFO [stderr] {'index': 13, 'preco': ''} 2020-04-12 21:01:39 DEBUG [scrapy.core.scraper] Scraped from <200 http://www.pudim.com.br/> {'index': 15, 'preco': ''} 2020-04-12 21:01:39 INFO [stderr] 2020-04-12 21:01:39 [scrapy.core.scraper] DEBUG: Scraped from <200 http://www.pudim.com.br/> 2020-04-12 21:01:39 INFO [stderr] {'index': 15, 'preco': ''} 2020-04-12 21:01:39 DEBUG [scrapy.core.scraper] Scraped from <200 http://www.pudim.com.br/> {'index': 9, 'preco': ''} 2020-04-12 21:01:39 INFO [stderr] 2020-04-12 21:01:39 [scrapy.core.scraper] DEBUG: Scraped from <200 http://www.pudim.com.br/> 2020-04-12 21:01:39 INFO [stderr] {'index': 9, 'preco': ''} 2020-04-12 21:01:39 DEBUG [scrapy.core.scraper] Scraped from <200 http://www.pudim.com.br/> {'index': 17, 'preco': ''} 2020-04-12 21:01:39 INFO [stderr] 2020-04-12 21:01:39 [scrapy.core.scraper] DEBUG: Scraped from <200 http://www.pudim.com.br/> 2020-04-12 21:01:39 INFO [stderr] {'index': 17, 'preco': ''} 2020-04-12 21:01:39 DEBUG [scrapy.core.engine] Crawled (200) (referer: None) 2020-04-12 21:01:39 INFO [stderr] 2020-04-12 21:01:39 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2020-04-12 21:01:39 DEBUG [scrapy.core.engine] Crawled (200) (referer: None) 2020-04-12 21:01:39 INFO [stderr] 2020-04-12 21:01:39 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2020-04-12 21:01:39 DEBUG [scrapy.core.engine] Crawled (200) (referer: None) 2020-04-12 21:01:39 INFO [stderr] 2020-04-12 21:01:39 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2020-04-12 21:01:39 DEBUG [scrapy.core.engine] Crawled (200) (referer: None) 2020-04-12 21:01:39 INFO [stderr] 2020-04-12 21:01:39 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2020-04-12 21:01:39 DEBUG [scrapy.core.engine] Crawled (200) (referer: None) 2020-04-12 21:01:39 INFO [stderr] 2020-04-12 21:01:39 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2020-04-12 21:01:39 DEBUG [scrapy.core.engine] Crawled (200) (referer: None) 2020-04-12 21:01:39 INFO [stderr] 2020-04-12 21:01:39 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2020-04-12 21:01:39 DEBUG [scrapy.core.engine] Crawled (200) (referer: None) 2020-04-12 21:01:39 INFO [stderr] 2020-04-12 21:01:39 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2020-04-12 21:01:39 DEBUG [scrapy.core.scraper] Scraped from <200 http://www.pudim.com.br/> {'index': 18, 'preco': ''} 2020-04-12 21:01:39 INFO [stderr] 2020-04-12 21:01:39 [scrapy.core.scraper] DEBUG: Scraped from <200 http://www.pudim.com.br/> 2020-04-12 21:01:39 INFO [stderr] {'index': 18, 'preco': ''} 2020-04-12 21:01:39 DEBUG [scrapy.downloadermiddlewares.redirect] Redirecting (301) to from 2020-04-12 21:01:39 INFO [stderr] 2020-04-12 21:01:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (301) to from 2020-04-12 21:01:39 DEBUG [scrapy.core.scraper] Scraped from <200 http://www.pudim.com.br/> {'index': 21, 'preco': ''} 2020-04-12 21:01:39 INFO [stderr] 2020-04-12 21:01:39 [scrapy.core.scraper] DEBUG: Scraped from <200 http://www.pudim.com.br/> 2020-04-12 21:01:39 INFO [stderr] {'index': 21, 'preco': ''} 2020-04-12 21:01:39 DEBUG [scrapy.core.scraper] Scraped from <200 http://www.pudim.com.br/> {'index': 22, 'preco': ''} 2020-04-12 21:01:39 INFO [stderr] 2020-04-12 21:01:39 [scrapy.core.scraper] DEBUG: Scraped from <200 http://www.pudim.com.br/> 2020-04-12 21:01:39 INFO [stderr] {'index': 22, 'preco': ''} 2020-04-12 21:01:39 DEBUG [scrapy.core.scraper] Scraped from <200 http://www.pudim.com.br/> {'index': 23, 'preco': ''} 2020-04-12 21:01:39 INFO [stderr] 2020-04-12 21:01:39 [scrapy.core.scraper] DEBUG: Scraped from <200 http://www.pudim.com.br/> 2020-04-12 21:01:39 INFO [stderr] {'index': 23, 'preco': ''} 2020-04-12 21:01:39 DEBUG [scrapy.core.scraper] Scraped from <200 http://www.pudim.com.br/> {'index': 24, 'preco': ''} 2020-04-12 21:01:39 INFO [stderr] 2020-04-12 21:01:39 [scrapy.core.scraper] DEBUG: Scraped from <200 http://www.pudim.com.br/> 2020-04-12 21:01:39 INFO [stderr] {'index': 24, 'preco': ''} 2020-04-12 21:01:39 DEBUG [scrapy.core.scraper] Scraped from <200 http://www.pudim.com.br/> {'index': 1, 'preco': ''} 2020-04-12 21:01:39 INFO [stderr] 2020-04-12 21:01:39 [scrapy.core.scraper] DEBUG: Scraped from <200 http://www.pudim.com.br/> 2020-04-12 21:01:39 INFO [stderr] {'index': 1, 'preco': ''} 2020-04-12 21:01:39 DEBUG [scrapy.core.scraper] Scraped from <200 http://www.pudim.com.br/> {'index': 25, 'preco': ''} 2020-04-12 21:01:39 INFO [stderr] 2020-04-12 21:01:39 [scrapy.core.scraper] DEBUG: Scraped from <200 http://www.pudim.com.br/> 2020-04-12 21:01:39 INFO [stderr] {'index': 25, 'preco': ''} 2020-04-12 21:01:39 DEBUG [scrapy.core.engine] Crawled (200) (referer: None) 2020-04-12 21:01:39 INFO [stderr] 2020-04-12 21:01:39 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2020-04-12 21:01:39 DEBUG [scrapy.core.scraper] Scraped from <200 http://www.pudim.com.br/> {'index': 26, 'preco': ''} 2020-04-12 21:01:39 INFO [stderr] 2020-04-12 21:01:39 [scrapy.core.scraper] DEBUG: Scraped from <200 http://www.pudim.com.br/> 2020-04-12 21:01:39 INFO [stderr] {'index': 26, 'preco': ''} 2020-04-12 21:01:40 DEBUG [scrapy.core.engine] Crawled (200) (referer: None) 2020-04-12 21:01:40 INFO [stderr] 2020-04-12 21:01:40 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2020-04-12 21:01:40 INFO [stdout] B07F6K7SDL 2020-04-12 21:01:42 DEBUG [scrapy.core.scraper] Scraped from <200 https://www.amazon.com.br/gp/offer-listing/B07F6K7SDL/ref=as_li_ss_tl?ie=UTF8&linkCode=sl2&tag=andreg109207-20&linkId=239faab6042dda0db5a68da14fa53585&language=pt_BR> {'index': 19, 'preco': 19.99} 2020-04-12 21:01:42 INFO [stderr] 2020-04-12 21:01:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.amazon.com.br/gp/offer-listing/B07F6K7SDL/ref=as_li_ss_tl?ie=UTF8&linkCode=sl2&tag=andreg109207-20&linkId=239faab6042dda0db5a68da14fa53585&language=pt_BR> 2020-04-12 21:01:42 INFO [stderr] {'index': 19, 'preco': 19.99} 2020-04-12 21:02:38 INFO [scrapy.extensions.logstats] Crawled 16 pages (at 16 pages/min), scraped 16 items (at 16 items/min) 2020-04-12 21:02:38 INFO [stderr] 2020-04-12 21:02:38 [scrapy.extensions.logstats] INFO: Crawled 16 pages (at 16 pages/min), scraped 16 items (at 16 items/min) 2020-04-12 21:03:38 INFO [scrapy.extensions.logstats] Crawled 16 pages (at 0 pages/min), scraped 16 items (at 0 items/min) 2020-04-12 21:03:38 INFO [stderr] 2020-04-12 21:03:38 [scrapy.extensions.logstats] INFO: Crawled 16 pages (at 0 pages/min), scraped 16 items (at 0 items/min) 2020-04-12 21:04:38 INFO [scrapy.extensions.logstats] Crawled 16 pages (at 0 pages/min), scraped 16 items (at 0 items/min) 2020-04-12 21:04:38 INFO [stderr] 2020-04-12 21:04:38 [scrapy.extensions.logstats] INFO: Crawled 16 pages (at 0 pages/min), scraped 16 items (at 0 items/min) 2020-04-12 21:05:38 INFO [scrapy.extensions.logstats] Crawled 16 pages (at 0 pages/min), scraped 16 items (at 0 items/min) 2020-04-12 21:05:38 INFO [stderr] 2020-04-12 21:05:38 [scrapy.extensions.logstats] INFO: Crawled 16 pages (at 0 pages/min), scraped 16 items (at 0 items/min) 2020-04-12 21:06:38 INFO [scrapy.extensions.logstats] Crawled 16 pages (at 0 pages/min), scraped 16 items (at 0 items/min) 2020-04-12 21:06:38 INFO [stderr] 2020-04-12 21:06:38 [scrapy.extensions.logstats] INFO: Crawled 16 pages (at 0 pages/min), scraped 16 items (at 0 items/min) 2020-04-12 21:07:38 INFO [scrapy.extensions.logstats] Crawled 16 pages (at 0 pages/min), scraped 16 items (at 0 items/min) 2020-04-12 21:07:38 INFO [stderr] 2020-04-12 21:07:38 [scrapy.extensions.logstats] INFO: Crawled 16 pages (at 0 pages/min), scraped 16 items (at 0 items/min) 2020-04-12 21:08:38 INFO [scrapy.extensions.logstats] Crawled 16 pages (at 0 pages/min), scraped 16 items (at 0 items/min) 2020-04-12 21:08:38 INFO [stderr] 2020-04-12 21:08:38 [scrapy.extensions.logstats] INFO: Crawled 16 pages (at 0 pages/min), scraped 16 items (at 0 items/min) 2020-04-12 21:09:38 INFO [scrapy.extensions.logstats] Crawled 16 pages (at 0 pages/min), scraped 16 items (at 0 items/min) 2020-04-12 21:09:38 INFO [stderr] 2020-04-12 21:09:38 [scrapy.extensions.logstats] INFO: Crawled 16 pages (at 0 pages/min), scraped 16 items (at 0 items/min) 2020-04-12 21:09:58 DEBUG [scrapy.downloadermiddlewares.retry] Retrying (failed 1 times): User timeout caused connection failure: Getting https://www.submarino.com.br/produto/133739829/game-naruto-to-boruto-shinobi-striker-day-one-ps4 took longer than 500 seconds.. 2020-04-12 21:09:58 INFO [stderr] 2020-04-12 21:09:58 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): User timeout caused connection failure: Getting https://www.submarino.com.br/produto/133739829/game-naruto-to-boruto-shinobi-striker-day-one-ps4 took longer than 500 seconds.. 2020-04-12 21:09:58 DEBUG [scrapy.downloadermiddlewares.retry] Retrying (failed 1 times): User timeout caused connection failure: Getting https://www.americanas.com.br/produto/1425247447/game-dragon-ball-z-kakarot-edicao-de-lancamento-ps4 took longer than 500 seconds.. 2020-04-12 21:09:58 INFO [stderr] 2020-04-12 21:09:58 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): User timeout caused connection failure: Getting https://www.americanas.com.br/produto/1425247447/game-dragon-ball-z-kakarot-edicao-de-lancamento-ps4 took longer than 500 seconds.. 2020-04-12 21:09:59 DEBUG [scrapy.downloadermiddlewares.retry] Retrying (failed 1 times): User timeout caused connection failure: Getting https://www.americanas.com.br/produto/133065705/game-dead-by-daylight-ps4 took longer than 500 seconds.. 2020-04-12 21:09:59 INFO [stderr] 2020-04-12 21:09:59 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): User timeout caused connection failure: Getting https://www.americanas.com.br/produto/133065705/game-dead-by-daylight-ps4 took longer than 500 seconds.. 2020-04-12 21:09:59 DEBUG [scrapy.downloadermiddlewares.retry] Retrying (failed 1 times): User timeout caused connection failure: Getting https://www.americanas.com.br/produto/128349771/game-ghostbusters-ps4?franq=AFL-03-232200 took longer than 500 seconds.. 2020-04-12 21:09:59 INFO [stderr] 2020-04-12 21:09:59 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): User timeout caused connection failure: Getting https://www.americanas.com.br/produto/128349771/game-ghostbusters-ps4?franq=AFL-03-232200 took longer than 500 seconds.. 2020-04-12 21:09:59 DEBUG [scrapy.downloadermiddlewares.retry] Retrying (failed 1 times): User timeout caused connection failure: Getting https://www.shoptime.com.br/produto/1459449063/game-the-last-of-us-ii-ps4?opn=AFLSHOP&epar=b2wafiliados&franq=AFL-03-232200 took longer than 500 seconds.. 2020-04-12 21:09:59 INFO [stderr] 2020-04-12 21:09:59 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): User timeout caused connection failure: Getting https://www.shoptime.com.br/produto/1459449063/game-the-last-of-us-ii-ps4?opn=AFLSHOP&epar=b2wafiliados&franq=AFL-03-232200 took longer than 500 seconds.. 2020-04-12 21:09:59 DEBUG [scrapy.downloadermiddlewares.retry] Retrying (failed 1 times): User timeout caused connection failure: Getting https://www.americanas.com.br/produto/134164107/game-the-witcher-3-wild-hunt-edicao-completa-ps4?opn=AFLACOM&epar=b2wafiliados&franq=AFL-03-232200 took longer than 500 seconds.. 2020-04-12 21:09:59 INFO [stderr] 2020-04-12 21:09:59 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): User timeout caused connection failure: Getting https://www.americanas.com.br/produto/134164107/game-the-witcher-3-wild-hunt-edicao-completa-ps4?opn=AFLACOM&epar=b2wafiliados&franq=AFL-03-232200 took longer than 500 seconds.. 2020-04-12 21:09:59 DEBUG [scrapy.downloadermiddlewares.retry] Retrying (failed 1 times): User timeout caused connection failure: Getting https://www.americanas.com.br/produto/123064653/game-batman-arkham-knight-ps4?opn=AFLACOM&epar=b2wafiliados&franq=AFL-03-232200 took longer than 500 seconds.. 2020-04-12 21:09:59 INFO [stderr] 2020-04-12 21:09:59 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): User timeout caused connection failure: Getting https://www.americanas.com.br/produto/123064653/game-batman-arkham-knight-ps4?opn=AFLACOM&epar=b2wafiliados&franq=AFL-03-232200 took longer than 500 seconds.. 2020-04-12 21:09:59 DEBUG [scrapy.downloadermiddlewares.retry] Retrying (failed 1 times): User timeout caused connection failure: Getting https://www.submarino.com.br/produto/134153707/game-dragon-age-inquisition-ps4?sellerId=00776574000660&opn=AFLSHOP&epar=b2wafiliados&franq=AFL-03-232200 took longer than 500 seconds.. 2020-04-12 21:09:59 INFO [stderr] 2020-04-12 21:09:59 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): User timeout caused connection failure: Getting https://www.submarino.com.br/produto/134153707/game-dragon-age-inquisition-ps4?sellerId=00776574000660&opn=AFLSHOP&epar=b2wafiliados&franq=AFL-03-232200 took longer than 500 seconds.. 2020-04-12 21:10:38 INFO [scrapy.extensions.logstats] Crawled 16 pages (at 0 pages/min), scraped 16 items (at 0 items/min) 2020-04-12 21:10:38 INFO [stderr] 2020-04-12 21:10:38 [scrapy.extensions.logstats] INFO: Crawled 16 pages (at 0 pages/min), scraped 16 items (at 0 items/min) 2020-04-12 21:11:38 INFO [scrapy.extensions.logstats] Crawled 16 pages (at 0 pages/min), scraped 16 items (at 0 items/min) 2020-04-12 21:11:38 INFO [stderr] 2020-04-12 21:11:38 [scrapy.extensions.logstats] INFO: Crawled 16 pages (at 0 pages/min), scraped 16 items (at 0 items/min) 2020-04-12 21:12:38 INFO [scrapy.extensions.logstats] Crawled 16 pages (at 0 pages/min), scraped 16 items (at 0 items/min) 2020-04-12 21:12:38 INFO [stderr] 2020-04-12 21:12:38 [scrapy.extensions.logstats] INFO: Crawled 16 pages (at 0 pages/min), scraped 16 items (at 0 items/min) 2020-04-12 21:13:38 INFO [scrapy.extensions.logstats] Crawled 16 pages (at 0 pages/min), scraped 16 items (at 0 items/min) 2020-04-12 21:13:38 INFO [stderr] 2020-04-12 21:13:38 [scrapy.extensions.logstats] INFO: Crawled 16 pages (at 0 pages/min), scraped 16 items (at 0 items/min) 2020-04-12 21:14:28 INFO [scrapy.crawler] Received SIGTERM, shutting down gracefully. Send again to force 2020-04-12 21:14:28 INFO [stderr] 2020-04-12 21:14:28 [scrapy.crawler] INFO: Received SIGTERM, shutting down gracefully. Send again to force 2020-04-12 21:14:28 INFO [scrapy.core.engine] Closing spider (shutdown) 2020-04-12 21:14:28 INFO [stderr] 2020-04-12 21:14:28 [scrapy.core.engine] INFO: Closing spider (shutdown) 2020-04-12 21:14:38 INFO [scrapy.extensions.logstats] Crawled 16 pages (at 0 pages/min), scraped 16 items (at 0 items/min) 2020-04-12 21:14:38 INFO [stderr] 2020-04-12 21:14:38 [scrapy.extensions.logstats] INFO: Crawled 16 pages (at 0 pages/min), scraped 16 items (at 0 items/min) 2020-04-12 21:15:38 INFO [scrapy.extensions.logstats] Crawled 16 pages (at 0 pages/min), scraped 16 items (at 0 items/min) 2020-04-12 21:15:38 INFO [stderr] 2020-04-12 21:15:38 [scrapy.extensions.logstats] INFO: Crawled 16 pages (at 0 pages/min), scraped 16 items (at 0 items/min) 2020-04-12 21:16:38 INFO [scrapy.extensions.logstats] Crawled 16 pages (at 0 pages/min), scraped 16 items (at 0 items/min) 2020-04-12 21:16:38 INFO [stderr] 2020-04-12 21:16:38 [scrapy.extensions.logstats] INFO: Crawled 16 pages (at 0 pages/min), scraped 16 items (at 0 items/min) 2020-04-12 21:17:38 INFO [scrapy.extensions.logstats] Crawled 16 pages (at 0 pages/min), scraped 16 items (at 0 items/min) 2020-04-12 21:17:38 INFO [stderr] 2020-04-12 21:17:38 [scrapy.extensions.logstats] INFO: Crawled 16 pages (at 0 pages/min), scraped 16 items (at 0 items/min) 2020-04-12 21:18:18 DEBUG [scrapy.downloadermiddlewares.retry] Retrying (failed 2 times): User timeout caused connection failure: Getting https://www.submarino.com.br/produto/133739829/game-naruto-to-boruto-shinobi-striker-day-one-ps4 took longer than 500 seconds.. 2020-04-12 21:18:18 INFO [stderr] 2020-04-12 21:18:18 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 2 times): User timeout caused connection failure: Getting https://www.submarino.com.br/produto/133739829/game-naruto-to-boruto-shinobi-striker-day-one-ps4 took longer than 500 seconds.. 2020-04-12 21:18:18 DEBUG [scrapy.downloadermiddlewares.retry] Retrying (failed 2 times): User timeout caused connection failure: Getting https://www.americanas.com.br/produto/1425247447/game-dragon-ball-z-kakarot-edicao-de-lancamento-ps4 took longer than 500 seconds.. 2020-04-12 21:18:18 INFO [stderr] 2020-04-12 21:18:18 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 2 times): User timeout caused connection failure: Getting https://www.americanas.com.br/produto/1425247447/game-dragon-ball-z-kakarot-edicao-de-lancamento-ps4 took longer than 500 seconds.. 2020-04-12 21:18:19 DEBUG [scrapy.downloadermiddlewares.retry] Retrying (failed 2 times): User timeout caused connection failure: Getting https://www.americanas.com.br/produto/133065705/game-dead-by-daylight-ps4 took longer than 500 seconds.. 2020-04-12 21:18:19 INFO [stderr] 2020-04-12 21:18:19 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 2 times): User timeout caused connection failure: Getting https://www.americanas.com.br/produto/133065705/game-dead-by-daylight-ps4 took longer than 500 seconds.. 2020-04-12 21:18:19 DEBUG [scrapy.downloadermiddlewares.retry] Retrying (failed 2 times): User timeout caused connection failure: Getting https://www.americanas.com.br/produto/128349771/game-ghostbusters-ps4?franq=AFL-03-232200 took longer than 500 seconds.. 2020-04-12 21:18:19 INFO [stderr] 2020-04-12 21:18:19 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 2 times): User timeout caused connection failure: Getting https://www.americanas.com.br/produto/128349771/game-ghostbusters-ps4?franq=AFL-03-232200 took longer than 500 seconds.. 2020-04-12 21:18:19 DEBUG [scrapy.downloadermiddlewares.retry] Retrying (failed 2 times): User timeout caused connection failure: Getting https://www.shoptime.com.br/produto/1459449063/game-the-last-of-us-ii-ps4?opn=AFLSHOP&epar=b2wafiliados&franq=AFL-03-232200 took longer than 500 seconds.. 2020-04-12 21:18:19 INFO [stderr] 2020-04-12 21:18:19 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 2 times): User timeout caused connection failure: Getting https://www.shoptime.com.br/produto/1459449063/game-the-last-of-us-ii-ps4?opn=AFLSHOP&epar=b2wafiliados&franq=AFL-03-232200 took longer than 500 seconds.. 2020-04-12 21:18:19 DEBUG [scrapy.downloadermiddlewares.retry] Retrying (failed 2 times): User timeout caused connection failure: Getting https://www.americanas.com.br/produto/134164107/game-the-witcher-3-wild-hunt-edicao-completa-ps4?opn=AFLACOM&epar=b2wafiliados&franq=AFL-03-232200 took longer than 500 seconds.. 2020-04-12 21:18:19 INFO [stderr] 2020-04-12 21:18:19 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 2 times): User timeout caused connection failure: Getting https://www.americanas.com.br/produto/134164107/game-the-witcher-3-wild-hunt-edicao-completa-ps4?opn=AFLACOM&epar=b2wafiliados&franq=AFL-03-232200 took longer than 500 seconds.. 2020-04-12 21:18:19 DEBUG [scrapy.downloadermiddlewares.retry] Retrying (failed 2 times): User timeout caused connection failure: Getting https://www.americanas.com.br/produto/123064653/game-batman-arkham-knight-ps4?opn=AFLACOM&epar=b2wafiliados&franq=AFL-03-232200 took longer than 500 seconds.. 2020-04-12 21:18:19 INFO [stderr] 2020-04-12 21:18:19 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 2 times): User timeout caused connection failure: Getting https://www.americanas.com.br/produto/123064653/game-batman-arkham-knight-ps4?opn=AFLACOM&epar=b2wafiliados&franq=AFL-03-232200 took longer than 500 seconds.. 2020-04-12 21:18:19 DEBUG [scrapy.downloadermiddlewares.retry] Retrying (failed 2 times): User timeout caused connection failure: Getting https://www.submarino.com.br/produto/134153707/game-dragon-age-inquisition-ps4?sellerId=00776574000660&opn=AFLSHOP&epar=b2wafiliados&franq=AFL-03-232200 took longer than 500 seconds.. 2020-04-12 21:18:19 INFO [stderr] 2020-04-12 21:18:19 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 2 times): User timeout caused connection failure: Getting https://www.submarino.com.br/produto/134153707/game-dragon-age-inquisition-ps4?sellerId=00776574000660&opn=AFLSHOP&epar=b2wafiliados&franq=AFL-03-232200 took longer than 500 seconds.. 2020-04-12 21:18:19 INFO [scrapy.statscollectors] Dumping Scrapy stats: {'downloader/exception_count': 16, 'downloader/exception_type_count/twisted.internet.error.TimeoutError': 16, 'downloader/request_bytes': 135873, 'downloader/request_count': 37, 'downloader/request_method_count/GET': 37, 'downloader/response_bytes': 85418, 'downloader/response_count': 21, 'downloader/response_status_count/200': 16, 'downloader/response_status_count/301': 1, 'downloader/response_status_count/302': 2, 'downloader/response_status_count/307': 2, 'dupefilter/filtered': 3, 'elapsed_time_seconds': 1000.72221, 'finish_reason': 'shutdown', 'finish_time': datetime.datetime(2020, 4, 12, 21, 18, 19, 516417), 'item_scraped_count': 16, 'log_count/DEBUG': 54, 'log_count/INFO': 27, 'memusage/max': 69885952, 'memusage/startup': 68132864, 'response_received_count': 16, 'retry/count': 16, 'retry/reason_count/twisted.internet.error.TimeoutError': 16, 'scheduler/dequeued': 37, 'scheduler/dequeued/memory': 37, 'scheduler/enqueued': 45, 'scheduler/enqueued/memory': 45, 'start_time': datetime.datetime(2020, 4, 12, 21, 1, 38, 794207)} 2020-04-12 21:18:19 INFO [stderr] 2020-04-12 21:18:19 [scrapy.statscollectors] INFO: Dumping Scrapy stats: 2020-04-12 21:18:19 INFO [stderr] {'downloader/exception_count': 16, 2020-04-12 21:18:19 INFO [stderr] 'downloader/exception_type_count/twisted.internet.error.TimeoutError': 16, 2020-04-12 21:18:19 INFO [stderr] 'downloader/request_bytes': 135873, 2020-04-12 21:18:19 INFO [stderr] 'downloader/request_count': 37, 2020-04-12 21:18:19 INFO [stderr] 'downloader/request_method_count/GET': 37, 2020-04-12 21:18:19 INFO [stderr] 'downloader/response_bytes': 85418, 2020-04-12 21:18:19 INFO [stderr] 'downloader/response_count': 21, 2020-04-12 21:18:19 INFO [stderr] 'downloader/response_status_count/200': 16, 2020-04-12 21:18:19 INFO [stderr] 'downloader/response_status_count/301': 1, 2020-04-12 21:18:19 INFO [stderr] 'downloader/response_status_count/302': 2, 2020-04-12 21:18:19 INFO [stderr] 'downloader/response_status_count/307': 2, 2020-04-12 21:18:19 INFO [stderr] 'dupefilter/filtered': 3, 2020-04-12 21:18:19 INFO [stderr] 'elapsed_time_seconds': 1000.72221, 2020-04-12 21:18:19 INFO [stderr] 'finish_reason': 'shutdown', 2020-04-12 21:18:19 INFO [stderr] 'finish_time': datetime.datetime(2020, 4, 12, 21, 18, 19, 516417), 2020-04-12 21:18:19 INFO [stderr] 'item_scraped_count': 16, 2020-04-12 21:18:19 INFO [stderr] 'log_count/DEBUG': 54, 2020-04-12 21:18:19 INFO [stderr] 'log_count/INFO': 27, 2020-04-12 21:18:19 INFO [stderr] 'memusage/max': 69885952, 2020-04-12 21:18:19 INFO [stderr] 'memusage/startup': 68132864, 2020-04-12 21:18:19 INFO [stderr] 'response_received_count': 16, 2020-04-12 21:18:19 INFO [stderr] 'retry/count': 16, 2020-04-12 21:18:19 INFO [stderr] 'retry/reason_count/twisted.internet.error.TimeoutError': 16, 2020-04-12 21:18:19 INFO [stderr] 'scheduler/dequeued': 37, 2020-04-12 21:18:19 INFO [stderr] 'scheduler/dequeued/memory': 37, 2020-04-12 21:18:19 INFO [stderr] 'scheduler/enqueued': 45, 2020-04-12 21:18:19 INFO [stderr] 'scheduler/enqueued/memory': 45, 2020-04-12 21:18:19 INFO [stderr] 'start_time': datetime.datetime(2020, 4, 12, 21, 1, 38, 794207)} 2020-04-12 21:18:19 INFO [scrapy.core.engine] Spider closed (shutdown) 2020-04-12 21:18:19 INFO [stderr] 2020-04-12 21:18:19 [scrapy.core.engine] INFO: Spider closed (shutdown) 2020-04-12 21:18:19 INFO Main loop terminated. 2020-04-12 21:18:19 DEBUG [oauth2client.crypt] [b'eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6ImUyYTkyZGY2ZDIyZTAzYjRlYmVmZDUzOGY1MDMzNDM4OTljMDM4NzQifQ', b'eyJhdWQiOiJodHRwczovL29hdXRoMi5nb29nbGVhcGlzLmNvbS90b2tlbiIsInNjb3BlIjoiaHR0cHM6Ly9zcHJlYWRzaGVldHMuZ29vZ2xlLmNvbS9mZWVkcyBodHRwczovL3d3dy5nb29nbGVhcGlzLmNvbS9hdXRoL2RyaXZlIiwiaWF0IjoxNTg2NzI2Mjk5LCJleHAiOjE1ODY3Mjk4OTksImlzcyI6InB5dGhvbnNwc2l0ZUBweXRob25zcHJlYWRzaGVldHNpdGUuaWFtLmdzZXJ2aWNlYWNjb3VudC5jb20ifQ', b'Sb6c8P7UUtkX4nShrf-ZD5O_2dXdvtXFc0gXFBHg9cLZlHdPU5CFEDWgc0eSapXVKHFBkYfXpZdzgQt9mcbAMux4_Sxziqm-9k0W7H8F3oBYcO2DMf4BbfbM1TgfKBsIv8QM8roqi8_YgwTnsEQl-XQmcLQa3vXBFpVgZi2Psg6iP0dUy7bfmqcvM0KuoIbtMUsg-yPQTl5AaerF27cK_aUQT06T_wdB4RnPGDjOHHS824Jc_McTSZBm411GrNKlouc5BQ-fCNFj7-a4KPJ9qsTw70C65cIdLNED8admX_KYDV7OIlQLQPIu4xYopI0d8xQw0clbz0LFe0tksR9Q8g'] 2020-04-12 21:18:19 INFO [stderr] 2020-04-12 21:18:19 [oauth2client.crypt] DEBUG: [b'eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6ImUyYTkyZGY2ZDIyZTAzYjRlYmVmZDUzOGY1MDMzNDM4OTljMDM4NzQifQ', b'eyJhdWQiOiJodHRwczovL29hdXRoMi5nb29nbGVhcGlzLmNvbS90b2tlbiIsInNjb3BlIjoiaHR0cHM6Ly9zcHJlYWRzaGVldHMuZ29vZ2xlLmNvbS9mZWVkcyBodHRwczovL3d3dy5nb29nbGVhcGlzLmNvbS9hdXRoL2RyaXZlIiwiaWF0IjoxNTg2NzI2Mjk5LCJleHAiOjE1ODY3Mjk4OTksImlzcyI6InB5dGhvbnNwc2l0ZUBweXRob25zcHJlYWRzaGVldHNpdGUuaWFtLmdzZXJ2aWNlYWNjb3VudC5jb20ifQ', b'Sb6c8P7UUtkX4nShrf-ZD5O_2dXdvtXFc0gXFBHg9cLZlHdPU5CFEDWgc0eSapXVKHFBkYfXpZdzgQt9mcbAMux4_Sxziqm-9k0W7H8F3oBYcO2DMf4BbfbM1TgfKBsIv8QM8roqi8_YgwTnsEQl-XQmcLQa3vXBFpVgZi2Psg6iP0dUy7bfmqcvM0KuoIbtMUsg-yPQTl5AaerF27cK_aUQT06T_wdB4RnPGDjOHHS824Jc_McTSZBm411GrNKlouc5BQ-fCNFj7-a4KPJ9qsTw70C65cIdLNED8admX_KYDV7OIlQLQPIu4xYopI0d8xQw0clbz0LFe0tksR9Q8g'] 2020-04-12 21:18:19 INFO [oauth2client.client] Refreshing access_token 2020-04-12 21:18:19 INFO [stderr] 2020-04-12 21:18:19 [oauth2client.client] INFO: Refreshing access_token 2020-04-12 21:18:20 INFO [stdout] ['', 1] 2020-04-12 21:18:21 INFO [stdout] ['', 4] 2020-04-12 21:18:21 INFO [stdout] ['', 7] 2020-04-12 21:18:21 INFO [stdout] ['', 9] 2020-04-12 21:18:23 INFO [stdout] ['', 13] 2020-04-12 21:18:23 INFO [stdout] ['', 14] 2020-04-12 21:18:23 INFO [stdout] ['', 15] 2020-04-12 21:18:24 INFO [stdout] ['', 17] 2020-04-12 21:18:24 INFO [stdout] ['', 18] 2020-04-12 21:18:24 INFO [stdout] ['19,99', 19] 2020-04-12 21:18:25 INFO [stdout] ['', 21] 2020-04-12 21:18:25 INFO [stdout] ['', 22] 2020-04-12 21:18:25 INFO [stdout] ['', 23] 2020-04-12 21:18:25 INFO [stdout] ['', 24] 2020-04-12 21:18:26 INFO [stdout] ['', 25] 2020-04-12 21:18:26 INFO [stdout] ['', 26]