Name | Started | Threads | Busy | |
---|---|---|---|---|
solaris-hive:1242
Queues: priority_crawl_importing, crawl_importing |
5 | 0 |
|
|
solaris-hive:1268
Queues: priority_scheduling, scheduling |
1 | 0 |
|
|
solaris-hive:1274
Queues: priority_trait_searching, trait_searching |
2 | 0 |
|
|
solaris-hive:1296
Queues: priority_scrape_starting, scrape_starting |
2 | 0 |
|
|
solaris-hive:1299
Queues: navigating |
1 | 0 |
|
|
solaris-hive:1303
Queues: priority_api_scraping, api_scraping |
3 | 0 |
|
|
solaris-hive:1305
Queues: priority_scrape_importing, scrape_importing |
10 | 1 |
|
|
solaris-hive:1319
Queues: priority_searching, searching |
2 | 0 |
|
|
solaris-hive:1335
Queues: priority_scraping, scraping |
15 | 3 |
|
|
solaris-hive:1337
Queues: priority_crawling, crawling |
3 | 0 |
|
Process | TID | JID | Queue | Job | Arguments | Started |
---|---|---|---|---|---|---|
solaris-hive:1305:9f6f602c7591 | 1czvp | e3a3c62ce4885a9420887b88 | scrape_importing | Deckhand::ScrapeImportWorker |
"626365", {}
|
|
solaris-hive:1335:263eb7a461e3 | z32v | c80293655bc97945884938e4 | scraping | Deckhand::ScrapeWorker |
{"input"=>{"articles"=>{"41213"=>{"url"=>"https://hlj.com/product/BAN989274", "layout_id"=>1}, "41551"=>{"url"=>"https://hlj.com/product/KBYFG-045", "layout_id"=>1}, "41603"=>{"url"=>"https://hlj.com/product/KBYP-146R", "layout_id"=>1}, "41714"=>{"url"=>"https://hlj.com/product/SGC67174", "layout_id"=>1}, "41785"=>{"url"=>"https://hlj.com/product/BAN978556", "layout_id"=>1}, "56567"=>{"url"=>"https://hlj.com/product/BAN956659", "layout_id"=>1}, "56571"=>{"url"=>"https://hlj.com/product/HBJ60738", "layout_id"=>1}, "56574"=>{"url"=>"https://hlj.com/product/SOF37095", "layout_id"=>1}, "56575"=>{"url"=>"https://hlj.com/product/MDW23671", "layout_id"=>1}, "56578"=>{"url"=>"https://hlj.com/product/GST1151144", "layout_id"=>1}, "56582"=>{"url"=>"https://hlj.com/product/BAN989239", "layout_id"=>1}, "56588"=>{"url"=>"https://hlj.com/product/ADNANE-0177", "layout_id"=>1}, "56590"=>{"url"=>"https://hlj.com/product/DIGWBF060", "layout_id"=>1}, "59071"=>{"url"=>"https://hlj.com/product/HQPMNP30R3", "layout_id"=>1}, "59078"=>{"url"=>"https://hlj.com/product/PLZAPM387411", "layout_id"=>1}, "59131"=>{"url"=>"https://hlj.com/product/SGC56798", "layout_id"=>1}, "59175"=>{"url"=>"https://hlj.com/product/DIGWST88", "layout_id"=>1}, "593930"=>{"url"=>"https://hlj.com/product/HTT29456", "layout_id"=>1}, "626365"=>{"url"=>"https://hlj.com/product/BANS63238", "layout_id"=>1}, "626366"=>{"url"=>"https://hlj.com/product/BANS63907", "layout_id"=>1}}, "layouts"=>{"1"=>{"encoding"=>nil, "cookies"=>[{"key"=>"hljCurrencyData", "value"=>"%7B%22currencyCode%22%3A%22JPY%22%2C%22currencyName%22%3A%22Japanese+Yen%22%2C%22currencyPrecision%22%3A0%2C%22currencyPattern%22%3A%22%5Cu00a5%25s%22%2C%22currencySymbol%22%3A%22%26yen%3B%22%2C%22fallbackCurrencyRate%22%3A1%2C%22selectedManually%22%3A0%7D", "domain"=>"hlj.com"}], "paths"=>{"image"=>{"path"=>"#hsId1 > div > div.highslide-thumbstrip-inner > table > tbody > tr", "subpath"=>"a", "fallback"=>nil, "regex"=>nil, "image"=>true, "target"=>"href", "read_htm...
|
|
solaris-hive:1335:263eb7a461e3 | zjcj | 88897d8f80bbaeff8b030dfc | scraping | Deckhand::ScrapeWorker |
{"input"=>{"articles"=>{"423707"=>{"url"=>"https://www.kuramatoys.com/kirie-kagarino-illustration-by-jin-happobi-1-6-pvc-figure/", "layout_id"=>19}, "423708"=>{"url"=>"https://www.kuramatoys.com/amazing-yamaguchi-no-009-batman-action-figure/", "layout_id"=>19}, "423709"=>{"url"=>"https://www.kuramatoys.com/kuon-kanokogi-rei-homare-artworks-1-5-pvc-figure/", "layout_id"=>19}, "423710"=>{"url"=>"https://www.kuramatoys.com/gokubi-girls-slender-glamorous-senran-kagura-newwave-g-burst-ryobi-x-ryona-bare-skin-sailor-suit-ver-1-10-pvc-figure/", "layout_id"=>19}, "423711"=>{"url"=>"https://www.kuramatoys.com/gokubi-girls-slender-glamorous-senran-kagura-newwave-g-burst-ryobi-bare-skin-sailor-suit-ver-1-10-pvc-figure/", "layout_id"=>19}, "423712"=>{"url"=>"https://www.kuramatoys.com/hdge-technical-statue-no-16-gantz-o-reika-gantz-sword-ver-pvc-figure/", "layout_id"=>19}, "423713"=>{"url"=>"https://www.kuramatoys.com/senren-banka-mako-hitachi-1-7-pvc-figure/", "layout_id"=>19}, "468827"=>{"url"=>"https://www.kuramatoys.com/https://www.matoys.com/figma-aqua-kono-subarashii-sekai-ni-syukufuku-wo-2-action-figure/", "layout_id"=>19}, "468828"=>{"url"=>"https://www.kuramatoys.com/https://www.matoys.com/artfx-premier-marvel-universe-cosmic-ghost-rider-1-10-pvc-figure/", "layout_id"=>19}, "468829"=>{"url"=>"https://www.kuramatoys.com/https://www.matoys.com/nier-automata-bring-arts-adam-eve-action-figure/", "layout_id"=>19}, "468830"=>{"url"=>"https://www.kuramatoys.com/https://www.matoys.com/g-e-m-series-naruto-shippuden-uzumaki-tailed-beasts-pvc-figure/", "layout_id"=>19}, "468831"=>{"url"=>"https://www.kuramatoys.com/https://www.matoys.com/miles-morales-hero-suit-into-the-spider-verse-marvel-universe-1-10-pvc-figure/", "layout_id"=>19}, "468832"=>{"url"=>"https://www.kuramatoys.com/https://www.matoys.com/mafex-no-100-mafex-michael-jordan-chicago-bulls-action-figure/", "layout_id"=>19}, "468833"=>{"url"=>"https://www.kuramatoys.com/https://www.matoys.com/border-break-kisei-hashiki-1-...
|
|
solaris-hive:1335:263eb7a461e3 | z8kn | 1d7e822cbde9ed45878f1ce8 | scraping | Deckhand::ScrapeWorker |
{"input"=>{"articles"=>{"375020"=>{"url"=>"http://www.cdjapan.co.jp/product/NEOGDS-113519?s_ssid=e445d5d9505537ff5", "layout_id"=>7}, "377743"=>{"url"=>"http://www.cdjapan.co.jp/product/NEOGDS-44751?s_ssid=e414575d95aa4cb888", "layout_id"=>7}, "378833"=>{"url"=>"http://www.cdjapan.co.jp/product/NEOGDS-100498?s_ssid=e34655d95f6c41d90", "layout_id"=>7}, "378941"=>{"url"=>"http://www.cdjapan.co.jp/product/NEOGDS-309008?s_ssid=e372a5d9611bce401", "layout_id"=>7}, "379161"=>{"url"=>"http://www.cdjapan.co.jp/product/NEOBK-1256586?s_ssid=e41c655d961d821e2", "layout_id"=>7}, "379173"=>{"url"=>"http://www.cdjapan.co.jp/product/NEOGDS-325726?s_ssid=e41d445d962ab94175", "layout_id"=>7}, "379191"=>{"url"=>"http://www.cdjapan.co.jp/product/NEOGDS-358505?s_ssid=e41d4f5d963b5b4887", "layout_id"=>7}, "379219"=>{"url"=>"http://www.cdjapan.co.jp/product/NEOGDS-341370?s_ssid=e41e3c5d9643c9b011", "layout_id"=>7}, "379227"=>{"url"=>"http://www.cdjapan.co.jp/product/NEOGDS-352674?s_ssid=e41e3c5d964c4b286a", "layout_id"=>7}, "379718"=>{"url"=>"http://www.cdjapan.co.jp/product/NEOGDS-50226?s_ssid=e42b0e5d96e4ecb04b", "layout_id"=>7}, "380139"=>{"url"=>"http://www.cdjapan.co.jp/product/NEOGDS-151248?s_ssid=e430965d97462a2ad", "layout_id"=>7}, "383830"=>{"url"=>"http://www.cdjapan.co.jp/product/NEOGDS-118142?s_ssid=e45a845d9a2022a3cb", "layout_id"=>7}, "384253"=>{"url"=>"http://www.cdjapan.co.jp/product/NEOGDS-319354?s_ssid=e3630d5d9b82933445", "layout_id"=>7}, "761229"=>{"url"=>"http://www.cdjapan.co.jp/https://www.cdjapan.co.jp/product/NEOGDS-826302", "layout_id"=>7}, "763185"=>{"url"=>"http://www.cdjapan.co.jp/https://www.cdjapan.co.jp/product/NEOGDS-828619", "layout_id"=>7}, "763834"=>{"url"=>"http://www.cdjapan.co.jp/https://www.cdjapan.co.jp/product/NEOGDS-822361", "layout_id"=>7}, "765400"=>{"url"=>"http://www.cdjapan.co.jp/https://www.cdjapan.co.jp/product/NEOGDS-833613", "layout_id"=>7}, "766458"=>{"url"=>"http://www.cdjapan.co.jp/https://www.cdjapan.co.jp/product/NEOGDS-792259", "la...
|