2026-05-10 16:00:05 [scrapy.utils.log] INFO: Scrapy 2.12.0 started (bot: competitor_spider) 2026-05-10 16:00:05 [scrapy.utils.log] INFO: Versions: lxml 6.1.0.0, libxml2 2.14.6, cssselect 1.4.0, parsel 1.11.0, w3lib 2.4.1, Twisted 25.5.0, Python 3.11.15 (main, Apr 7 2026, 02:24:41) [GCC 14.2.0], pyOpenSSL 26.0.0 (OpenSSL 3.5.6 7 Apr 2026), cryptography 46.0.7, Platform Linux-6.12.30+-x86_64-with-glibc2.41 2026-05-10 16:00:05 [competitor_spider.spiders.gebiz] INFO: GeBIZ spider starting in mode=closed 2026-05-10 16:00:05 [scrapy.addons] INFO: Enabled addons: [] 2026-05-10 16:00:05 [scrapy.extensions.telnet] INFO: Telnet Password: 3b56d6381c446788 2026-05-10 16:00:05 [scrapy.middleware] INFO: Enabled extensions: ['scrapy.extensions.corestats.CoreStats', 'scrapy.extensions.telnet.TelnetConsole', 'scrapy.extensions.memusage.MemoryUsage', 'scrapy.extensions.closespider.CloseSpider', 'scrapy.extensions.feedexport.FeedExporter', 'scrapy.extensions.logstats.LogStats'] 2026-05-10 16:00:05 [scrapy.crawler] INFO: Overridden settings: {'BOT_NAME': 'competitor_spider', 'CLOSESPIDER_PAGECOUNT': 500, 'CONCURRENT_REQUESTS': 1, 'CONCURRENT_REQUESTS_PER_DOMAIN': 1, 'DEPTH_LIMIT': 3, 'DOWNLOAD_DELAY': 3, 'DOWNLOAD_TIMEOUT': 60, 'LOG_FILE': '/var/lib/scrapyd/logs/competitors/gebiz/4c76c6264c8911f1b1460242ac1f0002.log', 'LOG_LEVEL': 'INFO', 'NEWSPIDER_MODULE': 'competitor_spider.spiders', 'RETRY_HTTP_CODES': [500, 502, 503, 504, 408, 429], 'ROBOTSTXT_OBEY': True, 'SPIDER_MODULES': ['competitor_spider.spiders'], 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor', 'USER_AGENT': 'ChalknPencilsBot/1.0 (+https://chalknpencils.com)'} 2026-05-10 16:00:05 [scrapy.middleware] INFO: Enabled downloader middlewares: ['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware', 'scrapy.downloadermiddlewares.robotstxt.RobotsTxtMiddleware', 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware', 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware', 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware', 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware', 'scrapy.downloadermiddlewares.retry.RetryMiddleware', 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware', 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware', 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware', 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware', 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware', 'scrapy.downloadermiddlewares.stats.DownloaderStats'] 2026-05-10 16:00:05 [scrapy.middleware] INFO: Enabled spider middlewares: ['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware', 'scrapy.spidermiddlewares.referer.RefererMiddleware', 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware', 'scrapy.spidermiddlewares.depth.DepthMiddleware'] 2026-05-10 16:00:05 [scrapy.middleware] INFO: Enabled item pipelines: ['competitor_spider.pipelines.WebhookPipeline'] 2026-05-10 16:00:05 [scrapy.core.engine] INFO: Spider opened 2026-05-10 16:00:05 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2026-05-10 16:00:05 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023 2026-05-10 16:00:05 [scrapy-playwright] INFO: Starting download handler 2026-05-10 16:00:05 [scrapy-playwright] INFO: Starting download handler 2026-05-10 16:00:05 [scrapy-playwright] INFO: Launching 1 startup context(s) 2026-05-10 16:00:05 [scrapy-playwright] INFO: Launching browser chromium 2026-05-10 16:00:05 [scrapy-playwright] INFO: Launching 1 startup context(s) 2026-05-10 16:00:05 [scrapy-playwright] INFO: Launching browser chromium 2026-05-10 16:00:05 [scrapy-playwright] INFO: Browser chromium launched 2026-05-10 16:00:05 [scrapy-playwright] INFO: Browser chromium launched 2026-05-10 16:00:05 [scrapy-playwright] INFO: Startup context(s) launched 2026-05-10 16:00:05 [scrapy-playwright] INFO: Startup context(s) launched 2026-05-10 16:00:17 [competitor_spider.spiders.gebiz] INFO: GeBIZ page loaded. Title: GeBIZ | Opportunities 2026-05-10 16:00:17 [competitor_spider.spiders.gebiz] INFO: --- Searching for: 'art instructor' --- 2026-05-10 16:00:23 [competitor_spider.spiders.gebiz] INFO: Submitted via mojarra.ab(contentForm:j_idt183_searchBar_BUTTON-GO, render=contentForm:j_idt183) 2026-05-10 16:00:31 [competitor_spider.spiders.gebiz] INFO: Debug screenshot saved to /var/lib/scrapyd/gebiz_debug.png 2026-05-10 16:00:31 [competitor_spider.spiders.gebiz] INFO: After search — Title: GeBIZ | Opportunities, URL: https://www.gebiz.gov.sg/ptn/opportunity/BOListing.xhtml 2026-05-10 16:00:31 [competitor_spider.spiders.gebiz] INFO: 'art instructor': 70 opportunities found 2026-05-10 16:00:31 [competitor_spider.spiders.gebiz] INFO: Found 3 result card headers 2026-05-10 16:00:31 [competitor_spider.spiders.gebiz] INFO: → MOESCHETQ26001900 | OPEN | Ministry of Education - Schools | Supply of AMIS Instructor (s) for Digital Art & Animation Programme in 2026-05-10 16:00:31 [competitor_spider.spiders.gebiz] INFO: → MOESCHETQ26001912 | OPEN | Ministry of Education - Schools | Supply of Instructors for P3 & P4 Mixed Medium Program for Visual Arts 2026-05-10 16:00:31 [competitor_spider.spiders.gebiz] INFO: → MOESCHETQ26001810 | OPEN | Ministry of Education - Schools | Supply of Instructors and Robotics Resources for Teacher Professional 2026-05-10 16:00:31 [competitor_spider.spiders.gebiz] INFO: 'art instructor': 3 detail pages to follow, 3 total QNs seen 2026-05-10 16:00:31 [competitor_spider.spiders.gebiz] INFO: --- Searching for: 'AMIS' --- 2026-05-10 16:00:36 [competitor_spider.spiders.gebiz] INFO: Submitted via mojarra.ab(contentForm:j_idt183_searchBar_BUTTON-GO, render=contentForm:j_idt183) 2026-05-10 16:00:43 [competitor_spider.spiders.gebiz] INFO: After search — Title: GeBIZ | Opportunities, URL: https://www.gebiz.gov.sg/ptn/opportunity/BOListing.xhtml 2026-05-10 16:00:43 [competitor_spider.spiders.gebiz] INFO: 'AMIS': 127 opportunities found 2026-05-10 16:00:43 [competitor_spider.spiders.gebiz] INFO: Found 8 result card headers 2026-05-10 16:00:43 [competitor_spider.spiders.gebiz] INFO: → MOESCHETQ26001884 | OPEN | Ministry of Education - Schools | Supply of AMIS Intructor for P5 Ceramic Arts Programme 2026-05-10 16:00:43 [competitor_spider.spiders.gebiz] INFO: → MOESCHETQ26001865 | OPEN | Ministry of Education - Schools | Supply of Instructor for P3 Orff & P4 Ukulele AMIS Program in Ahmad Ib 2026-05-10 16:00:43 [competitor_spider.spiders.gebiz] INFO: → CDVHQ0ETT26000010 | OPEN | Ministry of Social and Development - Ministry Headquarter | Invitation to Tender for the Provision of Family Connection Sessions ( 2026-05-10 16:00:43 [competitor_spider.spiders.gebiz] INFO: → CDVHQ0ETT26000009 | OPEN | Ministry of Social and Development - Ministry Headquarter | Invitation to Tender for Addition and Alteration (A&A) works at THK Ho 2026-05-10 16:00:43 [competitor_spider.spiders.gebiz] INFO: → MOESCHETQ26001872 | OPEN | Ministry of Education - Schools | Supply and Delivery of Foldable Desks for School Examination Purposes 2026-05-10 16:00:43 [competitor_spider.spiders.gebiz] INFO: → CDA000ETT26000005 | OPEN | Communicable Diseases Agency | (CDA-LOQ-ITT-2025-451) Invitation to Tender for the Provision of Gaseo 2026-05-10 16:00:43 [competitor_spider.spiders.gebiz] INFO: 'AMIS': 6 detail pages to follow, 10 total QNs seen 2026-05-10 16:00:43 [competitor_spider.spiders.gebiz] INFO: --- Searching for: 'art club' --- 2026-05-10 16:00:49 [competitor_spider.spiders.gebiz] INFO: Submitted via mojarra.ab(contentForm:j_idt183_searchBar_BUTTON-GO, render=contentForm:j_idt183) 2026-05-10 16:00:56 [competitor_spider.spiders.gebiz] INFO: After search — Title: GeBIZ | Opportunities, URL: https://www.gebiz.gov.sg/ptn/opportunity/BOListing.xhtml 2026-05-10 16:00:56 [competitor_spider.spiders.gebiz] INFO: 'art club': 16 opportunities found 2026-05-10 16:00:56 [competitor_spider.spiders.gebiz] INFO: Found 10 result card headers 2026-05-10 16:00:56 [competitor_spider.spiders.gebiz] INFO: → MOESCHETQ25007116 | AWARDED | Ministry of Education - Schools | 2026 CCA Art Club : Provision to engage CCA Art Club Instructors for D 2026-05-10 16:00:56 [competitor_spider.spiders.gebiz] INFO: → MOESCHETQ25007241 | AWARDED | Ministry of Education - Schools | Art Club Instructor for 2026 and 2027 2026-05-10 16:00:56 [competitor_spider.spiders.gebiz] INFO: → MOESCHETQ25006600 | AWARDED | Ministry of Education - Schools | Art Club Instructor Fees 2026 and option 2027 2026-05-10 16:00:56 [competitor_spider.spiders.gebiz] INFO: → MOESCHETQ26000364 | AWARDED | Ministry of Education - Schools | Supply of Instructor for Ceramics Enrichment Programme for Secondary 4 2026-05-10 16:00:56 [competitor_spider.spiders.gebiz] INFO: → MOESCHETQ25007347 | AWARDED | Ministry of Education - Schools | SKSS - Supply of Instructor for Art Club CCA Training Programme 2026-05-10 16:00:56 [competitor_spider.spiders.gebiz] INFO: → MOESCHETQ25006795 | AWARDED | Ministry of Education - Schools | Supply of 2 Art Club Instructors for 2026 with option to renew in 2027 2026-05-10 16:00:56 [competitor_spider.spiders.gebiz] INFO: → MOESCHETQ26001137 | AWARDED | Ministry of Education - Schools | Supply of Instructor for Art Club Training: Dry Pastel in Zhonghua Sec 2026-05-10 16:00:56 [competitor_spider.spiders.gebiz] INFO: → MOESCHETQ26000767 | AWARDED | Ministry of Education - Schools | Supply of Instructor for Art Club CCA Training Programme in Woodlands 2026-05-10 16:00:56 [competitor_spider.spiders.gebiz] INFO: → MOESCHETQ25007119 | AWARDED | Ministry of Education - Schools | 2026 CCA Art Club : Instructors for Ceramics and Assemblage for Jurong 2026-05-10 16:00:56 [competitor_spider.spiders.gebiz] INFO: → MOESCHETQ25006967 | AWARDED | Ministry of Education - Schools | Supply of Instructors for Art Club CCA in Nan Hua Primary School for y 2026-05-10 16:00:56 [competitor_spider.spiders.gebiz] INFO: 'art club': 10 detail pages to follow, 20 total QNs seen 2026-05-10 16:00:58 [competitor_spider.spiders.gebiz] INFO: Found 6 result card headers 2026-05-10 16:00:58 [competitor_spider.spiders.gebiz] INFO: → MOESCHETQ25006703 | AWARDED | Ministry of Education - Schools | Supply of Instructors for Art Club CCA Training Programme for Base Yea 2026-05-10 16:00:58 [competitor_spider.spiders.gebiz] INFO: → MOESCHETQ25007118 | AWARDED | Ministry of Education - Schools | 2026 CCA Art Club : Instructor for Digital and Time Based Media for Ju 2026-05-10 16:00:58 [competitor_spider.spiders.gebiz] INFO: → MOESCHETQ25006614 | AWARDED | Ministry of Education - Schools | Supply of Instructor for Art & Crafts Club CCA Training Programme for 2026-05-10 16:00:58 [competitor_spider.spiders.gebiz] INFO: → ITE000ETQ26000045 | PENDING AWARD | Institute of Technical Education | ITEa26-00142-WSDV - Provision of Artistic Direction & Instructorship f 2026-05-10 16:00:58 [competitor_spider.spiders.gebiz] INFO: → ITE000ETQ26000027 | NO AWARD | Institute of Technical Education | ITEa25-01201-WSDV - Provision of Artistic Direction & Instructorship f 2026-05-10 16:00:58 [competitor_spider.spiders.gebiz] INFO: → SPO000ETQ25000171 | NO AWARD | Singapore Polytechnic | SPO-REQ-2025-006449-SD-[ ARTS ] Quotation for the Provision of Coachin 2026-05-10 16:00:58 [competitor_spider.spiders.gebiz] INFO: 'art club' page 2: +6 new QNs (total 26) 2026-05-10 16:00:58 [competitor_spider.spiders.gebiz] INFO: --- Searching for: 'CCA art' --- 2026-05-10 16:01:03 [competitor_spider.spiders.gebiz] INFO: Submitted via mojarra.ab(contentForm:j_idt183_searchBar_BUTTON-GO, render=contentForm:j_idt183) 2026-05-10 16:01:05 [scrapy.extensions.logstats] INFO: Crawled 2 pages (at 2 pages/min), scraped 0 items (at 0 items/min) 2026-05-10 16:01:10 [competitor_spider.spiders.gebiz] INFO: After search — Title: GeBIZ | Opportunities, URL: https://www.gebiz.gov.sg/ptn/opportunity/BOListing.xhtml 2026-05-10 16:01:10 [competitor_spider.spiders.gebiz] INFO: 'CCA art': 21 opportunities found 2026-05-10 16:01:10 [competitor_spider.spiders.gebiz] INFO: Found 10 result card headers 2026-05-10 16:01:10 [competitor_spider.spiders.gebiz] INFO: → MOESCHETQ26001048 | AWARDED | Ministry of Education - Schools | Supply of Instructors for Art & Craft CCA Programme 2026 - Sand Animat 2026-05-10 16:01:10 [competitor_spider.spiders.gebiz] INFO: → MOESCHETQ25007037 | AWARDED | Ministry of Education - Schools | Supply of Instructor for Ceramics programme for Art Vista CCA Training 2026-05-10 16:01:10 [competitor_spider.spiders.gebiz] INFO: → MOESCHETQ26001576 | AWARDED | Ministry of Education - Schools | Supply of Performance Venue and Services for Aesthetics Showcase by th 2026-05-10 16:01:10 [competitor_spider.spiders.gebiz] INFO: 'CCA art': 3 detail pages to follow, 29 total QNs seen 2026-05-10 16:01:12 [competitor_spider.spiders.gebiz] INFO: Found 10 result card headers 2026-05-10 16:01:12 [competitor_spider.spiders.gebiz] INFO: → INDACIETQ26000006 | AWARDED | Anglo-Chinese School (Independent) | PROVISION OF BLACK BLAZERS FOR STUDENTS OF PERFORMING ARTS CCA IN YEAR 2026-05-10 16:01:12 [competitor_spider.spiders.gebiz] INFO: → MOESCHETQ25007364 | AWARDED | Ministry of Education - Schools | Supply of Instructors for Digital Artisans CCA Training Programme in C 2026-05-10 16:01:12 [competitor_spider.spiders.gebiz] INFO: → ITE000ETQ26000028 | PENDING AWARD | Institute of Technical Education | ITEa25-01211-WSDV - Provision of Artistic Direction & Instructorship f 2026-05-10 16:01:12 [competitor_spider.spiders.gebiz] INFO: → ITE000ETQ26000026 | PENDING AWARD | Institute of Technical Education | ITEa25-01204-WSDV - Provision of Artistic Direction & Instructorship f 2026-05-10 16:01:12 [competitor_spider.spiders.gebiz] INFO: → MOESCHETQ26000203 | AWARDED | Ministry of Education - Schools | SUPPLY OF INSTRUCTOR FOR FOOTBALL BOYS (B & C DIV) CCA TRAINING PROGRA 2026-05-10 16:01:12 [competitor_spider.spiders.gebiz] INFO: → MOESCHETQ25007011 | AWARDED | Ministry of Education - Schools | CHIJ Katong Convent - Employ three drama instructors for Dramatic Arts 2026-05-10 16:01:12 [competitor_spider.spiders.gebiz] INFO: 'CCA art' page 2: +6 new QNs (total 35) 2026-05-10 16:01:13 [competitor_spider.spiders.gebiz] INFO: Found 1 result card headers 2026-05-10 16:01:13 [competitor_spider.spiders.gebiz] INFO: → MOESCHETQ25006875 | AWARDED | Ministry of Education - Schools | Supply of instructors for Artistic Gymnastics CCA Training Programme i 2026-05-10 16:01:13 [competitor_spider.spiders.gebiz] INFO: 'CCA art' page 3: +1 new QNs (total 36) 2026-05-10 16:01:13 [competitor_spider.spiders.gebiz] INFO: --- Searching for: 'visual art' --- 2026-05-10 16:01:21 [competitor_spider.spiders.gebiz] INFO: Submitted via mojarra.ab(contentForm:j_idt183_searchBar_BUTTON-GO, render=contentForm:j_idt183) 2026-05-10 16:01:28 [competitor_spider.spiders.gebiz] INFO: After search — Title: GeBIZ | Opportunities, URL: https://www.gebiz.gov.sg/ptn/opportunity/BOListing.xhtml 2026-05-10 16:01:28 [competitor_spider.spiders.gebiz] INFO: 'visual art': 5 opportunities found 2026-05-10 16:01:28 [competitor_spider.spiders.gebiz] INFO: Found 1 result card headers 2026-05-10 16:01:28 [competitor_spider.spiders.gebiz] INFO: 'visual art': 0 detail pages to follow, 36 total QNs seen 2026-05-10 16:01:28 [competitor_spider.spiders.gebiz] INFO: --- Searching for: 'painting' --- 2026-05-10 16:01:33 [competitor_spider.spiders.gebiz] INFO: Submitted via mojarra.ab(contentForm:j_idt183_searchBar_BUTTON-GO, render=contentForm:j_idt183) 2026-05-10 16:01:40 [competitor_spider.spiders.gebiz] INFO: After search — Title: GeBIZ | Opportunities, URL: https://www.gebiz.gov.sg/ptn/opportunity/BOListing.xhtml 2026-05-10 16:01:40 [competitor_spider.spiders.gebiz] INFO: 'painting': 13 opportunities found 2026-05-10 16:01:40 [competitor_spider.spiders.gebiz] INFO: Found 2 result card headers 2026-05-10 16:01:40 [competitor_spider.spiders.gebiz] INFO: 'painting': 0 detail pages to follow, 38 total QNs seen 2026-05-10 16:01:40 [competitor_spider.spiders.gebiz] INFO: --- Searching for: 'drawing' --- 2026-05-10 16:01:46 [competitor_spider.spiders.gebiz] INFO: Submitted via mojarra.ab(contentForm:j_idt183_searchBar_BUTTON-GO, render=contentForm:j_idt183) 2026-05-10 16:01:53 [competitor_spider.spiders.gebiz] INFO: After search — Title: GeBIZ | Opportunities, URL: https://www.gebiz.gov.sg/ptn/opportunity/BOListing.xhtml 2026-05-10 16:01:53 [competitor_spider.spiders.gebiz] INFO: 'drawing': 3 opportunities found 2026-05-10 16:01:53 [competitor_spider.spiders.gebiz] INFO: Found 3 result card headers 2026-05-10 16:01:53 [competitor_spider.spiders.gebiz] INFO: → MOESCHETQ26001520 | PENDING AWARD | Ministry of Education - Schools | Supply of AMIS Instructor for Primary Visual Arts Programme (i.e. Draw 2026-05-10 16:01:53 [competitor_spider.spiders.gebiz] INFO: 'drawing': 1 detail pages to follow, 40 total QNs seen 2026-05-10 16:01:53 [competitor_spider.spiders.gebiz] INFO: --- Searching for: 'manga' --- 2026-05-10 16:01:58 [competitor_spider.spiders.gebiz] INFO: Submitted via mojarra.ab(contentForm:j_idt183_searchBar_BUTTON-GO, render=contentForm:j_idt183) 2026-05-10 16:02:05 [scrapy.extensions.logstats] INFO: Crawled 2 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2026-05-10 16:02:05 [competitor_spider.spiders.gebiz] INFO: After search — Title: GeBIZ | Opportunities, URL: https://www.gebiz.gov.sg/ptn/opportunity/BOListing.xhtml 2026-05-10 16:02:05 [competitor_spider.spiders.gebiz] WARNING: 'manga': no result count found on page. Title: GeBIZ | Opportunities 2026-05-10 16:02:05 [competitor_spider.spiders.gebiz] INFO: Debug — text inputs: 3, first 20 link texts: ['Trusted websites', 'Home', 'Opportunities', 'Supplier Directory', 'SIGN UP', 'WHICH TO USE?', 'Home', 'Opportunities', 'Supplier Directory', 'Log in for Companies', 'Log in for Individuals', 'Log in for Foreigners w/o Singpass', 'WHICH TO USE?', 'SIGN UP', "Today's Opportunities", 'Advanced Search', 'Match Any', '\n ', '\n ', '\n '] 2026-05-10 16:02:05 [competitor_spider.spiders.gebiz] INFO: Found 0 result card headers 2026-05-10 16:02:05 [competitor_spider.spiders.gebiz] INFO: 'manga': 0 detail pages to follow, 40 total QNs seen 2026-05-10 16:02:24 [competitor_spider.spiders.gebiz] INFO: Clicked Respondents tab for MOESCHETQ25006875 2026-05-10 16:02:28 [competitor_spider.spiders.gebiz] INFO: Extracted 0 bids for MOESCHETQ25006875 2026-05-10 16:02:35 [competitor_spider.spiders.gebiz] INFO: Clicked Respondents tab for MOESCHETQ25007011 2026-05-10 16:02:39 [competitor_spider.spiders.gebiz] INFO: Extracted 0 bids for MOESCHETQ25007011 2026-05-10 16:02:44 [competitor_spider.spiders.gebiz] INFO: Clicked Respondents tab for MOESCHETQ26000203 2026-05-10 16:02:47 [competitor_spider.spiders.gebiz] INFO: Extracted 0 bids for MOESCHETQ26000203 2026-05-10 16:03:05 [scrapy.extensions.logstats] INFO: Crawled 9 pages (at 7 pages/min), scraped 7 items (at 7 items/min) 2026-05-10 16:03:07 [competitor_spider.spiders.gebiz] INFO: Clicked Respondents tab for MOESCHETQ25007364 2026-05-10 16:03:10 [competitor_spider.spiders.gebiz] INFO: Extracted 0 bids for MOESCHETQ25007364 2026-05-10 16:03:15 [competitor_spider.spiders.gebiz] INFO: Clicked Respondents tab for INDACIETQ26000006 2026-05-10 16:03:18 [competitor_spider.spiders.gebiz] INFO: Extracted 0 bids for INDACIETQ26000006 2026-05-10 16:03:25 [competitor_spider.spiders.gebiz] INFO: Clicked Respondents tab for MOESCHETQ26001576 2026-05-10 16:03:29 [competitor_spider.spiders.gebiz] INFO: Extracted 0 bids for MOESCHETQ26001576 2026-05-10 16:03:34 [competitor_spider.spiders.gebiz] INFO: Clicked Respondents tab for MOESCHETQ25007037 2026-05-10 16:03:37 [competitor_spider.spiders.gebiz] INFO: Extracted 0 bids for MOESCHETQ25007037 2026-05-10 16:03:42 [competitor_spider.spiders.gebiz] INFO: Clicked Respondents tab for MOESCHETQ26001048 2026-05-10 16:03:46 [competitor_spider.spiders.gebiz] INFO: Extracted 0 bids for MOESCHETQ26001048 2026-05-10 16:03:58 [competitor_spider.spiders.gebiz] INFO: Clicked Respondents tab for SPO000ETQ25000171 2026-05-10 16:04:01 [competitor_spider.spiders.gebiz] INFO: Extracted 0 bids for SPO000ETQ25000171 2026-05-10 16:04:05 [scrapy.extensions.logstats] INFO: Crawled 16 pages (at 7 pages/min), scraped 13 items (at 6 items/min) 2026-05-10 16:04:06 [competitor_spider.spiders.gebiz] INFO: Clicked Respondents tab for ITE000ETQ26000027 2026-05-10 16:04:09 [competitor_spider.spiders.gebiz] INFO: Extracted 0 bids for ITE000ETQ26000027 2026-05-10 16:04:25 [competitor_spider.spiders.gebiz] INFO: Clicked Respondents tab for MOESCHETQ25006614 2026-05-10 16:04:30 [competitor_spider.spiders.gebiz] INFO: Extracted 0 bids for MOESCHETQ25006614 2026-05-10 16:04:39 [competitor_spider.spiders.gebiz] INFO: Clicked Respondents tab for MOESCHETQ25007118 2026-05-10 16:04:43 [competitor_spider.spiders.gebiz] INFO: Extracted 0 bids for MOESCHETQ25007118 2026-05-10 16:04:48 [competitor_spider.spiders.gebiz] INFO: Clicked Respondents tab for MOESCHETQ25006703 2026-05-10 16:04:51 [competitor_spider.spiders.gebiz] INFO: Extracted 0 bids for MOESCHETQ25006703 2026-05-10 16:04:56 [competitor_spider.spiders.gebiz] INFO: Clicked Respondents tab for MOESCHETQ25006967 2026-05-10 16:05:00 [competitor_spider.spiders.gebiz] INFO: Extracted 0 bids for MOESCHETQ25006967 2026-05-10 16:05:05 [scrapy.extensions.logstats] INFO: Crawled 22 pages (at 6 pages/min), scraped 19 items (at 6 items/min) 2026-05-10 16:05:05 [competitor_spider.pipelines] INFO: Webhook POST 20 items -> 200 2026-05-10 16:05:05 [competitor_spider.spiders.gebiz] INFO: Clicked Respondents tab for MOESCHETQ25007119 2026-05-10 16:05:11 [competitor_spider.spiders.gebiz] INFO: Extracted 0 bids for MOESCHETQ25007119 2026-05-10 16:05:16 [competitor_spider.spiders.gebiz] INFO: Clicked Respondents tab for MOESCHETQ26000767 2026-05-10 16:05:19 [competitor_spider.spiders.gebiz] INFO: Extracted 0 bids for MOESCHETQ26000767 2026-05-10 16:05:24 [competitor_spider.spiders.gebiz] INFO: Clicked Respondents tab for MOESCHETQ26001137 2026-05-10 16:05:27 [competitor_spider.spiders.gebiz] INFO: Extracted 0 bids for MOESCHETQ26001137 2026-05-10 16:05:34 [competitor_spider.spiders.gebiz] INFO: Clicked Respondents tab for MOESCHETQ25006795 2026-05-10 16:05:40 [competitor_spider.spiders.gebiz] INFO: Extracted 0 bids for MOESCHETQ25006795 2026-05-10 16:05:45 [competitor_spider.spiders.gebiz] INFO: Clicked Respondents tab for MOESCHETQ25007347 2026-05-10 16:05:48 [competitor_spider.spiders.gebiz] INFO: Extracted 0 bids for MOESCHETQ25007347 2026-05-10 16:05:53 [competitor_spider.spiders.gebiz] INFO: Clicked Respondents tab for MOESCHETQ26000364 2026-05-10 16:05:57 [competitor_spider.spiders.gebiz] INFO: Extracted 0 bids for MOESCHETQ26000364 2026-05-10 16:06:05 [scrapy.extensions.logstats] INFO: Crawled 28 pages (at 6 pages/min), scraped 25 items (at 6 items/min) 2026-05-10 16:06:05 [competitor_spider.spiders.gebiz] INFO: Clicked Respondents tab for MOESCHETQ25006600 2026-05-10 16:06:08 [competitor_spider.spiders.gebiz] INFO: Extracted 0 bids for MOESCHETQ25006600 2026-05-10 16:06:13 [competitor_spider.spiders.gebiz] INFO: Clicked Respondents tab for MOESCHETQ25007241 2026-05-10 16:06:16 [competitor_spider.spiders.gebiz] INFO: Extracted 0 bids for MOESCHETQ25007241 2026-05-10 16:06:24 [competitor_spider.spiders.gebiz] INFO: Clicked Respondents tab for MOESCHETQ25007116 2026-05-10 16:06:31 [competitor_spider.spiders.gebiz] INFO: Extracted 0 bids for MOESCHETQ25007116 2026-05-10 16:07:05 [scrapy.extensions.logstats] INFO: Crawled 35 pages (at 7 pages/min), scraped 33 items (at 8 items/min) 2026-05-10 16:07:21 [scrapy.core.engine] INFO: Closing spider (finished) 2026-05-10 16:07:21 [competitor_spider.pipelines] INFO: Webhook POST 16 items -> 200 2026-05-10 16:07:22 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (36 items) in: file:///var/lib/scrapyd/items/competitors/gebiz/4c76c6264c8911f1b1460242ac1f0002.jl 2026-05-10 16:07:22 [scrapy.statscollectors] INFO: Dumping Scrapy stats: {'downloader/request_bytes': 32115, 'downloader/request_count': 38, 'downloader/request_method_count/GET': 38, 'downloader/response_bytes': 4202307, 'downloader/response_count': 38, 'downloader/response_status_count/200': 38, 'elapsed_time_seconds': 436.820928, 'feedexport/success_count/FileFeedStorage': 1, 'finish_reason': 'finished', 'finish_time': datetime.datetime(2026, 5, 10, 16, 7, 22, 95828, tzinfo=datetime.timezone.utc), 'item_scraped_count': 36, 'items_per_minute': None, 'log_count/INFO': 168, 'log_count/WARNING': 1, 'memusage/max': 153604096, 'memusage/startup': 78299136, 'playwright/context_count': 2, 'playwright/context_count/max_concurrent': 1, 'playwright/context_count/persistent/False': 2, 'playwright/context_count/remote/False': 2, 'playwright/page_count': 37, 'playwright/page_count/max_concurrent': 1, 'playwright/request_count': 5411, 'playwright/request_count/method/GET': 5253, 'playwright/request_count/method/POST': 158, 'playwright/request_count/navigation': 112, 'playwright/request_count/resource_type/document': 112, 'playwright/request_count/resource_type/font': 540, 'playwright/request_count/resource_type/image': 1796, 'playwright/request_count/resource_type/script': 2068, 'playwright/request_count/resource_type/stylesheet': 760, 'playwright/request_count/resource_type/xhr': 135, 'playwright/response_count': 5411, 'playwright/response_count/method/GET': 5253, 'playwright/response_count/method/POST': 158, 'playwright/response_count/resource_type/document': 112, 'playwright/response_count/resource_type/font': 540, 'playwright/response_count/resource_type/image': 1796, 'playwright/response_count/resource_type/script': 2068, 'playwright/response_count/resource_type/stylesheet': 760, 'playwright/response_count/resource_type/xhr': 135, 'request_depth_max': 1, 'response_received_count': 38, 'responses_per_minute': None, 'robotstxt/request_count': 1, 'robotstxt/response_count': 1, 'robotstxt/response_status_count/200': 1, 'scheduler/dequeued': 37, 'scheduler/dequeued/memory': 37, 'scheduler/enqueued': 37, 'scheduler/enqueued/memory': 37, 'start_time': datetime.datetime(2026, 5, 10, 16, 0, 5, 274900, tzinfo=datetime.timezone.utc)} 2026-05-10 16:07:22 [scrapy.core.engine] INFO: Spider closed (finished) 2026-05-10 16:07:22 [scrapy-playwright] INFO: Closing download handler 2026-05-10 16:07:22 [scrapy-playwright] INFO: Closing browser 2026-05-10 16:07:22 [scrapy-playwright] INFO: Closing download handler 2026-05-10 16:07:22 [scrapy-playwright] INFO: Closing browser