linux - Running python program after it is terminated via crontab -


i have python webscraping program needs scrapped continuously after program terminated. technique follows

crontab -e (settings)

* * * * * /home/ahmed/desktop/run.sh

run.sh

    tmp_file=/tmp/i_am_running     [ -f $tmp_file ] && exit     touch $tmp_file     /usr/bin/python /home/ahmed/desktop/python.py     rm $tmp_file

the bash code must have problem or may command in crontab wrong. program not running. please guide

after mark suggestions modified script this

#!/bin/bash path=$path:/bin:/usr/bin  date +'%h:%m:%s started' >> /home/ahmed/desktop/log.txt  tmp_file=/tmp/i_am_running [ -f $tmp_file ] && exit touch $tmp_file  date +'%h:%m:%s starting python' >> /home/ahmed/desktop/log.txt /usr/bin/python /home/ahmed/desktop/python.py rm $tmp_file  date +'%h:%m:%s ended' >> /home/ahmed/desktop/log.txt

the cron command using * * * * * /home/ahmed/desktop/run.sh

the log file created this

15:21:01 started 15:21:02 starting python 15:22:02 started 15:23:01 started 15:24:01 started 15:24:30 ended 15:25:01 started 15:25:01 starting python 15:26:01 started 15:27:18 started 15:28:01 started 15:29:01 started 15:30:01 started 15:31:01 started 15:31:16 ended 15:32:01 started 15:32:01 starting python 15:33:01 started 15:34:01 started

it seems program restarted before ended. log file should have starting program, started, ended, starting program, started, ended , on.

can guide me please?

have made script executable?

chmod +x /home/ahmed/desktop/run.sh

put proper shebang , path in script starts this:

 #!/bin/bash  path=$path:/bin:/usr/bin

try script on own command line

/home/ahmed/desktop/run.sh

if doesn't work, change shebang line add -xv @ end

#!/bin/bash -xv

check see if /tmp/i_am_running exists

check cron log

grep cron /var/log/syslog

consider changing script can see when started and/or if ran python:

#!/bin/bash path=$path:/bin:/usr/bin  date +'%h:%m:%s started' >> /home/ahmed/desktop/log.txt  tmp_file=/tmp/i_am_running [ -f $tmp_file ] && exit touch $tmp_file  date +'%h:%m:%s starting python' >> /home/ahmed/desktop/log.txt /usr/bin/python /home/ahmed/desktop/python.py rm $tmp_file  date +'%h:%m:%s ended' >> /home/ahmed/desktop/log.txt

by way, not sure how running once @ 18:01 constitutes "continuous scraping"?


Comments

Post a Comment

Popular posts from this blog

android - Get AccessToken using signpost OAuth without opening a browser (Two legged Oauth) -

i using signpost oauth access data magento server. have read various tutorials on same , reach point open browser user can enter credentials. however, per requirement have automate part. hence, user should not browser page. have set-up done on server side ( magento ), hit url , returned call page. same through program in android. i have tried below, consumer = new commonshttpoauthconsumer(key, secret); provider = new commonshttpoauthprovider(oauth_init_url,access_token_url, authorize_url); try { provider.retrieverequesttoken(consumer, oauth.out_of_band); log.d("tokens" , consumer.gettoken() + " -- " + consumer.gettokensecret()); } and request tokens. dont know how bypass next step. tried directly accessing accesstoken (stupid of me) provider.retrieveaccesstoken(consumer, "mycallback://callback"); no luck, ends in oauth.signpost.exception.oauthnotauthorizedexception: authorization failed (server replied 401). ...
Read more

org.mockito.exceptions.misusing.InvalidUseOfMatchersException: mockito -

getting error org.mockito.exceptions.misusing.invaliduseofmatchersexception: invalid use of argument matchers! 1 matchers expected, 2 recorded. exception may occur if matchers combined raw values: //incorrect: somemethod(anyobject(), "raw string"); when using matchers, arguments have provided matchers. example: //correct: somemethod(anyobject(), eq("string matcher")); at when( getprogramservice .callservice(any(getprogramtype.class))) .thenreturn(jaxbresponse); please explain error , possible resolution the code posted looks fine; don't see problem it. code before or above causing exception. key here: invalid use of argument matchers! 1 matchers expected, 2 recorded. any , used above, doesn't return "special kind of null" or "special kind of getprogramtype"; don't exist. instead, returns null , side effect puts matcher on stack. whe...
Read more

google shop client API returns 400 bad request error while adding an item -

i'm working on solution add items in google shopping market java application. following tutorial real mess because of missing classes of laste release, after setting 1.5-beta maven managed make base example typecheck correctly classes. still can make simple task of adding 1 item. instead of posting whole code i'm posting part creates product feed. private product createproduct(string id) { product product = new product(); product.title = "red wool sweater"; product.content = new content( "text", "comfortable , soft, sweater keep warm on " + "cold winter nights. red , blue stripes."); product.appcontrol = new appcontrol(); product.appcontrol.addrequireddestination("productads"); product.externalid = id; product.lang = "it"; product.country = "it"; product.condition = "nuovo"; product.price = new price("eu...
Read more