lucene - Sitecore 7 ContentSearch crawling failure: "Crawler : AddRecursive DoItemAdd failed" -


when try rebuild our lucene (contentsearch) indexes, our crawlinglog filled these exceptions:

7052 15:08:21 warn  crawler : addrecursive doitemadd failed - {5a1e50e4-46b9-42d5-b743-1ed10d15d47e} exception: system.aggregateexception message: 1 or more errors occurred. source: mscorlib    @ system.threading.tasks.task.wait(int32 millisecondstimeout, cancellationtoken cancellationtoken)    @ system.threading.tasks.task.wait()    @ system.threading.tasks.parallel.partitionerforeachworker[tsource,tlocal](partitioner`1 source, paralleloptions paralleloptions, action`1 simplebody, action`2 bodywithstate, action`3 bodywithstateandindex, func`4 bodywithstateandlocal, func`5 bodywitheverything, func`1 localinit, action`1 localfinally)    @ system.threading.tasks.parallel.foreachworker[tsource,tlocal](ienumerable`1 source, paralleloptions paralleloptions, action`1 body, action`2 bodywithstate, action`3 bodywithstateandindex, func`4 bodywithstateandlocal, func`5 bodywitheverything, func`1 localinit, action`1 localfinally)    @ system.threading.tasks.parallel.foreach[tsource](ienumerable`1 source, paralleloptions paralleloptions, action`1 body)    @ sitecore.contentsearch.abstractdocumentbuilder`1.additemfields()    @ sitecore.contentsearch.luceneprovider.crawlerluceneindexoperations.getindexdata(iindexable indexable, iproviderupdatecontext context)    @ sitecore.contentsearch.luceneprovider.crawlerluceneindexoperations.builddatatoindex(iproviderupdatecontext context, iindexable version)    @ sitecore.contentsearch.luceneprovider.crawlerluceneindexoperations.add(iindexable indexable, iproviderupdatecontext context, providerindexconfiguration indexconfiguration)    @ sitecore.contentsearch.sitecoreitemcrawler.doadd(iproviderupdatecontext context, sitecoreindexableitem indexable)    @ sitecore.contentsearch.hierarchicaldatacrawler`1.crawlitem(tuple`3 tuple) nested exception exception: system.argumentoutofrangeexception message: index , length must refer location within string. parameter name: length source: mscorlib    @ system.string.internalsubstringwithchecks(int32 startindex, int32 length, boolean falwayscopy)    @ sitecore.data.shortid.encode(string guid)    @ sitecore.contentsearch.fieldreaders.multilistfieldreader.getfieldvalue(iindexabledatafield indexablefield)    @ sitecore.contentsearch.fieldreaders.fieldreadermap.getfieldvalue(iindexabledatafield field)    @ sitecore.contentsearch.luceneprovider.lucenedocumentbuilder.addfield(iindexabledatafield field)    @ system.threading.tasks.parallel.<>c__displayclass32`2.<partitionerforeachworker>b__30()    @ system.threading.tasks.task.innerinvokewitharg(task childtask)    @ system.threading.tasks.task.<>c__displayclass11.<executeselfreplicating>b__10(object param0)

this appears caused shortid.encode(string) method expecting guid in string parameter have brackets (" { " , " } ") around it. of our multilist field relationships associated programmatically using guid.tostring(), not include brackets. unfortunately, these values cause shortid.encode() method choke.

  1. first things first: find places call multilistfield.add(string) , change guid.tostring() guid.tostring("b"). resolve issue new relationships.
  2. create custom fieldreader class replace standard multilistfieldreader (we called ours custommultilistfieldreader).
  3. set custom class inherit sitecore.contentsearch.fieldreaders.fieldreader.
  4. decompile sitecore.contentsearch.fieldreaders.multilistfieldreader.getfieldvalue(iindexabledatafield) method custom class.

  5. before if (id.isid(id)) line, add following code:

    if (!str.startswith("{") && !str.endswith("}"))     id = string.format("{{{0}}}", str);

  6. in index configuration (we added ours default, sitecore.contentsearch.defaultindexconfiguration.config) change fieldreadertype multilist fields custom type. (this can found in config @ sitecore/contentsearch/configuration/defaultindexconfiguration/fieldreaders/mapfieldbytypename/fieldreader.)

full disclosure: don't love approach because if default implementation of multilistfieldreader ever changed, we'd without changes. allows items included in index without reformatting of guids in every multilist field.


Comments

Post a Comment

Popular posts from this blog

android - Get AccessToken using signpost OAuth without opening a browser (Two legged Oauth) -

i using signpost oauth access data magento server. have read various tutorials on same , reach point open browser user can enter credentials. however, per requirement have automate part. hence, user should not browser page. have set-up done on server side ( magento ), hit url , returned call page. same through program in android. i have tried below, consumer = new commonshttpoauthconsumer(key, secret); provider = new commonshttpoauthprovider(oauth_init_url,access_token_url, authorize_url); try { provider.retrieverequesttoken(consumer, oauth.out_of_band); log.d("tokens" , consumer.gettoken() + " -- " + consumer.gettokensecret()); } and request tokens. dont know how bypass next step. tried directly accessing accesstoken (stupid of me) provider.retrieveaccesstoken(consumer, "mycallback://callback"); no luck, ends in oauth.signpost.exception.oauthnotauthorizedexception: authorization failed (server replied 401). ...
Read more

org.mockito.exceptions.misusing.InvalidUseOfMatchersException: mockito -

getting error org.mockito.exceptions.misusing.invaliduseofmatchersexception: invalid use of argument matchers! 1 matchers expected, 2 recorded. exception may occur if matchers combined raw values: //incorrect: somemethod(anyobject(), "raw string"); when using matchers, arguments have provided matchers. example: //correct: somemethod(anyobject(), eq("string matcher")); at when( getprogramservice .callservice(any(getprogramtype.class))) .thenreturn(jaxbresponse); please explain error , possible resolution the code posted looks fine; don't see problem it. code before or above causing exception. key here: invalid use of argument matchers! 1 matchers expected, 2 recorded. any , used above, doesn't return "special kind of null" or "special kind of getprogramtype"; don't exist. instead, returns null , side effect puts matcher on stack. whe...
Read more

google shop client API returns 400 bad request error while adding an item -

i'm working on solution add items in google shopping market java application. following tutorial real mess because of missing classes of laste release, after setting 1.5-beta maven managed make base example typecheck correctly classes. still can make simple task of adding 1 item. instead of posting whole code i'm posting part creates product feed. private product createproduct(string id) { product product = new product(); product.title = "red wool sweater"; product.content = new content( "text", "comfortable , soft, sweater keep warm on " + "cold winter nights. red , blue stripes."); product.appcontrol = new appcontrol(); product.appcontrol.addrequireddestination("productads"); product.externalid = id; product.lang = "it"; product.country = "it"; product.condition = "nuovo"; product.price = new price("eu...
Read more