python - parsing space delimited, named fields -


i have specific format of data (exported splunk>) mixture of csv , named fields. understand if possible in python parse such data via template (or simplified, average-human understandable regex)

"harry potter", "book", "12 mar 2014 note=""good"" language=""english""" "forrest gump", "movie", "14 march 2015 note=""good"" language=""aztec"""

as can see first fields comma separated, comes 1 long string starts date , have few named fields (note, language).

i build list of dicts solely named fields:

[     {'note': 'good', 'language'='english'},     {'note': 'good', 'language'='aztec'} ]

after parsing csv end last field (e.g. "12 mar 2014 note=""good"" language=""english""" first line) , stuck, solution can think of try describe line in regex (which scary :). if managed extract tuples, how translate them dict?

the csv module handle outer and doubled quoting you, out of box. columns have outer quotes (making sure delimiters, quotes , newlines in values preserved), , quotes in values doubled; csv.reader() remove outer quotes , return strings single quotes 3rd column.

the named fields can handled regular expression:

import csv import re  keyvalue = re.compile(r'([^"= ]+)="([^"]+)"')   open(filename, 'rb') infh:     reader = csv.reader(infh, skipinitialspace=true)     namedfields = [dict(keyvalue.findall(row[2])) row in reader]

the skipinitialspace option removes spaces after delimiter; needed ensure spaces before quoted column values removed correctly, in turn ensuring quoting handled.

the re.findall() method here returns list of (key, value) tuples, , dict() type turn directly dictionary.

demo:

>>> import csv >>> import re >>> keyvalue = re.compile(r'([^"= ]+)="([^"]+)"') >>> sample = '''\ ... "harry potter", "book", "12 mar 2014 note=""good"" language=""english""" ... "forrest gump", "movie", "14 march 2015 note=""good"" language=""aztec""" ... ''' >>> reader = csv.reader(sample.splitlines(true), skipinitialspace=true) >>> [dict(keyvalue.findall(row[2])) row in reader] [{'note': 'good', 'language': 'english'}, {'note': 'good', 'language': 'aztec'}]

Comments

Post a Comment

Popular posts from this blog

android - Get AccessToken using signpost OAuth without opening a browser (Two legged Oauth) -

i using signpost oauth access data magento server. have read various tutorials on same , reach point open browser user can enter credentials. however, per requirement have automate part. hence, user should not browser page. have set-up done on server side ( magento ), hit url , returned call page. same through program in android. i have tried below, consumer = new commonshttpoauthconsumer(key, secret); provider = new commonshttpoauthprovider(oauth_init_url,access_token_url, authorize_url); try { provider.retrieverequesttoken(consumer, oauth.out_of_band); log.d("tokens" , consumer.gettoken() + " -- " + consumer.gettokensecret()); } and request tokens. dont know how bypass next step. tried directly accessing accesstoken (stupid of me) provider.retrieveaccesstoken(consumer, "mycallback://callback"); no luck, ends in oauth.signpost.exception.oauthnotauthorizedexception: authorization failed (server replied 401). ...
Read more

org.mockito.exceptions.misusing.InvalidUseOfMatchersException: mockito -

getting error org.mockito.exceptions.misusing.invaliduseofmatchersexception: invalid use of argument matchers! 1 matchers expected, 2 recorded. exception may occur if matchers combined raw values: //incorrect: somemethod(anyobject(), "raw string"); when using matchers, arguments have provided matchers. example: //correct: somemethod(anyobject(), eq("string matcher")); at when( getprogramservice .callservice(any(getprogramtype.class))) .thenreturn(jaxbresponse); please explain error , possible resolution the code posted looks fine; don't see problem it. code before or above causing exception. key here: invalid use of argument matchers! 1 matchers expected, 2 recorded. any , used above, doesn't return "special kind of null" or "special kind of getprogramtype"; don't exist. instead, returns null , side effect puts matcher on stack. whe...
Read more

google shop client API returns 400 bad request error while adding an item -

i'm working on solution add items in google shopping market java application. following tutorial real mess because of missing classes of laste release, after setting 1.5-beta maven managed make base example typecheck correctly classes. still can make simple task of adding 1 item. instead of posting whole code i'm posting part creates product feed. private product createproduct(string id) { product product = new product(); product.title = "red wool sweater"; product.content = new content( "text", "comfortable , soft, sweater keep warm on " + "cold winter nights. red , blue stripes."); product.appcontrol = new appcontrol(); product.appcontrol.addrequireddestination("productads"); product.externalid = id; product.lang = "it"; product.country = "it"; product.condition = "nuovo"; product.price = new price("eu...
Read more