java - Best way to compare big csv files? -


i must application, compares big csv files, each 1 having 40,000 records. have done application, works properly, spends lot of time in doing comparison, because 2 files disordenated or have different records - must iterate (40000^2)*2 times.

here code:

  if (nomfich.equals("car"))     {     while ((linea = br3.readline()) != null)     {                  array =linea.split(",");                 spliteado = array[0]+array[1]+array[2]+array[8];                  filereader fh3 = new filereader(cadena + lista2[0]);                 bufferedreader bh3 = new bufferedreader(fh3);                  find=0;                  while (((linea2 = bh3.readline()) != null))                  {                     array2 =linea2.split(",");                     spliteado2 = array2[0]+array2[1]+array2[2]+array2[8];                       if (spliteado.equals(spliteado2))                     {                          find =1;                     }                  }                 if (find==0)                  {                     bw3.write("+++++++++++++++++++++++++++++++++++++++++++");                     bw3.newline();                     bw3.write("se han incorporado los siguientes cgi en la nueva lista");                     bw3.newline();                     bw3.write(linea);                     bw3.newline();                     aparece=1;                 }                 bh3.close();       }

i think using set in java option, following post suggests: comparing 2 csv files in java

but before try way, know, if there better options.

thanks all.

hashmap<string, string> file1map = new hashmap<string, string>();  while ((string line = file1.readline()) != null) {   array =line.split(",");   key = array[0]+array[1]+array[2]+array[8];   file1map.put(key, key); }  while ((string line = file2.readline()) != null) {   array =line.split(",");   key = array[0]+array[1]+array[2]+array[8];   if (file1map.containskey(key)) {     //if file1 has same line in file2   }   else {     //if file1 doesn't have line in file2   } }

Comments

Post a Comment

Popular posts from this blog

android - Get AccessToken using signpost OAuth without opening a browser (Two legged Oauth) -

i using signpost oauth access data magento server. have read various tutorials on same , reach point open browser user can enter credentials. however, per requirement have automate part. hence, user should not browser page. have set-up done on server side ( magento ), hit url , returned call page. same through program in android. i have tried below, consumer = new commonshttpoauthconsumer(key, secret); provider = new commonshttpoauthprovider(oauth_init_url,access_token_url, authorize_url); try { provider.retrieverequesttoken(consumer, oauth.out_of_band); log.d("tokens" , consumer.gettoken() + " -- " + consumer.gettokensecret()); } and request tokens. dont know how bypass next step. tried directly accessing accesstoken (stupid of me) provider.retrieveaccesstoken(consumer, "mycallback://callback"); no luck, ends in oauth.signpost.exception.oauthnotauthorizedexception: authorization failed (server replied 401). ...
Read more

org.mockito.exceptions.misusing.InvalidUseOfMatchersException: mockito -

getting error org.mockito.exceptions.misusing.invaliduseofmatchersexception: invalid use of argument matchers! 1 matchers expected, 2 recorded. exception may occur if matchers combined raw values: //incorrect: somemethod(anyobject(), "raw string"); when using matchers, arguments have provided matchers. example: //correct: somemethod(anyobject(), eq("string matcher")); at when( getprogramservice .callservice(any(getprogramtype.class))) .thenreturn(jaxbresponse); please explain error , possible resolution the code posted looks fine; don't see problem it. code before or above causing exception. key here: invalid use of argument matchers! 1 matchers expected, 2 recorded. any , used above, doesn't return "special kind of null" or "special kind of getprogramtype"; don't exist. instead, returns null , side effect puts matcher on stack. whe...
Read more

google shop client API returns 400 bad request error while adding an item -

i'm working on solution add items in google shopping market java application. following tutorial real mess because of missing classes of laste release, after setting 1.5-beta maven managed make base example typecheck correctly classes. still can make simple task of adding 1 item. instead of posting whole code i'm posting part creates product feed. private product createproduct(string id) { product product = new product(); product.title = "red wool sweater"; product.content = new content( "text", "comfortable , soft, sweater keep warm on " + "cold winter nights. red , blue stripes."); product.appcontrol = new appcontrol(); product.appcontrol.addrequireddestination("productads"); product.externalid = id; product.lang = "it"; product.country = "it"; product.condition = "nuovo"; product.price = new price("eu...
Read more