Amazon Glue Crawler Not Crawling All the Data -

-

in data below, crawler on amazon ( plan push data s3 using crawler), crawls 10th row stops, though there more data.

my data looks this: 

{"fullreferrer":"(direct)","jscountry":"malaysia","medium":"(none)","campaign":"(not set)","operatingsystem":"(not set)","devicecategory":"desktop","datasource":"web","country":"china","sessions":"2","users":"2","newusers":"2"} {"fullreferrer":"(direct)","jscountry":"malaysia","medium":"(none)","campaign":"(not set)","operatingsystem":"(not set)","devicecategory":"desktop","datasource":"web","country":"malaysia","sessions":"2","users":"2","newusers":"2"} {"fullreferrer":"(direct)","jscountry":"malaysia","medium":"(none)","campaign":"(not set)","operatingsystem":"(not set)","devicecategory":"desktop","datasource":"web","country":"united states","sessions":"11","users":"11","newusers":"11"} {"fullreferrer":"(direct)","jscountry":"malaysia","medium":"(none)","campaign":"(not set)","operatingsystem":"android","devicecategory":"mobile","datasource":"(not set)","country":"india","sessions":"1","users":"1","newusers":"1"} {"fullreferrer":"(direct)","jscountry":"malaysia","medium":"(none)","campaign":"(not set)","operatingsystem":"android","devicecategory":"mobile","datasource":"amp","country":"malaysia","sessions":"1","users":"1","newusers":"0"} {"fullreferrer":"(direct)","jscountry":"malaysia","medium":"(none)","campaign":"(not set)","operatingsystem":"android","devicecategory":"mobile","datasource":"web","country":"brazil","sessions":"1","users":"1","newusers":"0"} {"fullreferrer":"(direct)","jscountry":"malaysia","medium":"(none)","campaign":"(not set)","operatingsystem":"android","devicecategory":"mobile","datasource":"web","country":"cambodia","sessions":"2","users":"1","newusers":"1"} {"fullreferrer":"(direct)","jscountry":"malaysia","medium":"(none)","campaign":"(not set)","operatingsystem":"android","devicecategory":"mobile","datasource":"web","country":"egypt","sessions":"1","users":"1","newusers":"1"} {"fullreferrer":"(direct)","jscountry":"malaysia","medium":"(none)","campaign":"(not set)","operatingsystem":"android","devicecategory":"mobile","datasource":"web","country":"france","sessions":"1","users":"1","newusers":"1"} {"fullreferrer":"(direct)","jscountry":"malaysia","medium":"(none)","campaign":"(not set)","operatingsystem":"android","devicecategory":"mobile","datasource":"web","country":"ghana","sessions":"3","users":"2","newusers":"2"} {"fullreferrer":"(direct)","jscountry":"malaysia","medium":"(none)","campaign":"(not set)","operatingsystem":"android","devicecategory":"mobile","datasource":"web","country":"hong kong","sessions":"1","users":"1","newusers":"1"} {"fullreferrer":"(direct)","jscountry":"malaysia","medium":"(none)","campaign":"(not set)","operatingsystem":"android","devicecategory":"mobile","datasource":"web","country":"india","sessions":"13","users":"12","newusers":"7"} {"fullreferrer":"(direct)","jscountry":"malaysia","medium":"(none)","campaign":"(not set)","operatingsystem":"android","devicecategory":"mobile","datasource":"web","country":"indonesia","sessions":"4","users":"4","newusers":"3"} {"fullreferrer":"(direct)","jscountry":"malaysia","medium":"(none)","campaign":"(not set)","operatingsystem":"android","devicecategory":"mobile","datasource":"web","country":"kenya","sessions":"1","users":"1","newusers":"1"} {"fullreferrer":"(direct)","jscountry":"malaysia","medium":"(none)","campaign":"(not set)","operatingsystem":"android","devicecategory":"mobile","datasource":"web","country":"malaysia","sessions":"464","users":"407","newusers":"283"} {"fullreferrer":"(direct)","jscountry":"malaysia","medium":"(none)","campaign":"(not set)","operatingsystem":"android","devicecategory":"mobile","datasource":"web","country":"philippines","sessions":"6","users":"6","newusers":"4"}


Comments

Post a Comment

Popular posts from this blog

ZeroMQ on Windows, with Qt Creator -

-
i have installed zmq link given below on windows 7. http://zeromq.org/distro:microsoft-windows 1) have c++ project in qt-creator , i'm using zmq c++ binding (zhelpers.hpp etc). 2) have added .lib installed zmq folder qtcreator 3) while compiling, compiler looks _imp__zmq_verion, in .dll files present in .lib have __imp_zmq_version. 4) causing undefined reference zmq_version. anyone else faced problem , has solution ?
Read more

unity3d - Unity SceneManager.LoadScene quits application -

-
i have 2 different scenes 1 named 'main' , other 'game' both added scenes in load. when use scenemanager.loadscene("game"); works no problem when tried return main scene code if (input.getkeydown (keycode.escape)) { scenemanager.loadscene("main"); } strangely game quits. thanks. sorry interruption. somewhere on other script found code. if (input.getkeydown (keycode.escape)) { application.quit (); } that's bad, know...
Read more

python - Error while using APScheduler: 'NoneType' object has no attribute 'now' -

-
i have python app hosting on heroku. use apscheduler call function every day @ time. strange thing 1 time function runs after while have following error log: exception in thread apscheduler (most raised during interpreter shutdown): 2017-09-06t15:03:28.347848+00:00 app[web.1]: traceback (most recent call last): 2017-09-06t15:03:28.347858+00:00 app[web.1]: file "/app/.heroku/python/lib/python2.7/threading.py", line 810, in __bootstrap_inner 2017-09-06t15:03:28.347859+00:00 app[web.1]: file "/app/.heroku/python/lib/python2.7/threading.py", line 763, in run 2017-09-06t15:03:28.347861+00:00 app[web.1]: file "/app/.heroku/python/lib/python2.7/site-packages/apscheduler/schedulers/blocking.py", line 27, in _main_loop 2017-09-06t15:03:28.348167+00:00 app[web.1]: <type 'exceptions.attributeerror'>: 'nonetype' object has no attribute 'now' any guesses? the full code long here key parts: def startdayauto(): global ...
Read more