c# - Accessing Azure Table storage from Map/Reduce job running in a HDInsight cluster -


we running m/r job on 4-node hdinsight cluster, written in c#. 1 of mapper classes uses azure table storage apply business specific rules.

the m/r job runs correctly, if no cloudtable, cloudtableclient & cloudstorageaccount objects created.

but, on adding object references same, gives errors , job execution stops. part of code snippet given below:

public class topprogmapper : mapperbase {     cloudtable table = null;     cloudstorageaccount storageaccount = null;     cloudtableclient tableclient = null;      //the above objects instantiated , queried in mapper ctor      public topprogmapper()     {         // instantiation code here, has been commented     } }

code in mapper's ctor has been commented execution errrors-out when no object references created, described above.

the error code received mapreduceresult object (info.exitcode) 1, indicating issue m/r code. but, rest of code runs absolutely fine , produces correct output when above reference objects not created.

any on highly appreciated. provide additional details, if required.

thanks & regards, subho

it sounds assembly containing coudtable, cloudstorageaccount , cloudtableclient not available on cluster mapper running. should microsoft.windowsazure.storage.dll or microsoft.windowsazure.storageclient.dll depending on version of api using.

try adding config.filestoinclude.add("microsoft.windowsazure.storage.dll"); in configure method.

if doesn't help, share command line & output or code & exception details attempt launch job.


Comments

Post a Comment

Popular posts from this blog

android - Get AccessToken using signpost OAuth without opening a browser (Two legged Oauth) -

i using signpost oauth access data magento server. have read various tutorials on same , reach point open browser user can enter credentials. however, per requirement have automate part. hence, user should not browser page. have set-up done on server side ( magento ), hit url , returned call page. same through program in android. i have tried below, consumer = new commonshttpoauthconsumer(key, secret); provider = new commonshttpoauthprovider(oauth_init_url,access_token_url, authorize_url); try { provider.retrieverequesttoken(consumer, oauth.out_of_band); log.d("tokens" , consumer.gettoken() + " -- " + consumer.gettokensecret()); } and request tokens. dont know how bypass next step. tried directly accessing accesstoken (stupid of me) provider.retrieveaccesstoken(consumer, "mycallback://callback"); no luck, ends in oauth.signpost.exception.oauthnotauthorizedexception: authorization failed (server replied 401). ...
Read more

org.mockito.exceptions.misusing.InvalidUseOfMatchersException: mockito -

getting error org.mockito.exceptions.misusing.invaliduseofmatchersexception: invalid use of argument matchers! 1 matchers expected, 2 recorded. exception may occur if matchers combined raw values: //incorrect: somemethod(anyobject(), "raw string"); when using matchers, arguments have provided matchers. example: //correct: somemethod(anyobject(), eq("string matcher")); at when( getprogramservice .callservice(any(getprogramtype.class))) .thenreturn(jaxbresponse); please explain error , possible resolution the code posted looks fine; don't see problem it. code before or above causing exception. key here: invalid use of argument matchers! 1 matchers expected, 2 recorded. any , used above, doesn't return "special kind of null" or "special kind of getprogramtype"; don't exist. instead, returns null , side effect puts matcher on stack. whe...
Read more

google shop client API returns 400 bad request error while adding an item -

i'm working on solution add items in google shopping market java application. following tutorial real mess because of missing classes of laste release, after setting 1.5-beta maven managed make base example typecheck correctly classes. still can make simple task of adding 1 item. instead of posting whole code i'm posting part creates product feed. private product createproduct(string id) { product product = new product(); product.title = "red wool sweater"; product.content = new content( "text", "comfortable , soft, sweater keep warm on " + "cold winter nights. red , blue stripes."); product.appcontrol = new appcontrol(); product.appcontrol.addrequireddestination("productads"); product.externalid = id; product.lang = "it"; product.country = "it"; product.condition = "nuovo"; product.price = new price("eu...
Read more