OrientDB ETL: Looking for efficient work-around for lack of edge: skipDuplicates option -

-

i tried transformation { "edge" : { "class":"my_edge","skipduplicates":true } }...then noticed documentation had in of version 2.2. (4 releases now!?)

i'm bit stuck on viable work-around. have single flat file i'm trying break out 5 different objects. (things have deal when data end users).

i'd hoped skipduplicates option on vertex by-pass remaining transforms, no such luck.

is there block or command work-around can use. don't think sql lookup work, since other edges batch not have been committed yet.

by way, i've noticed when tried hack edge index, ended in kind of infinite loop...

thanks assistance.

update example -i'm using 2.1.8

here's basics of configuration

    {          "transformers" : [               { "merge": { "joinfieldname":"document_id", "lookup":"article.document_id" } },               { "vertex": { "class": "article" , "skipduplicates":true } },               { "edge": { "class":"belongs_to", "skipduplicates":true, "direction":"out","joinfieldname": "journal_id", "lookup":"journal.journal_id", "unresolvedlinkaction":"create"} },              ...           ]      }    //and of course, i've listed classes , indexes within orientdb loader      "classes":[          { "name":"content", "extends":"v" },          { "name":"article", "extends":"content" },          { "name":"belongs_to", "extends":"e" }      ],      "indexes": [          {"class":"article", "fields":["document_id:string"], "type":"unique" }      ]


Comments

Post a Comment

Popular posts from this blog

Capture and play voice with Asterisk ARI -

-
there channel ari demo in wich can control channel state: ring, answer, play silence, play tone or audio-file ( https://github.com/asterisk/ari-examples/tree/master/channel-state , https://wiki.asterisk.org/wiki/display/ast/ari+and+channels%3a+manipulating+channel+state ) possible receive chunks (parts, buffers, etc.) of call voice (which created remote subscriber) or write chunks of voice, example array of bytes (not file) in audio format (alaw, ulow etc). you can use asterisk eagi interface voice data. other option use record or mixmonitor app record channel(channel have put stasis allow dialplan control ari) "write chunks of voice" can done application playback also can create own application using c/c++, compile asterisk , result want. no, can't redirect voice directly using ari.
Read more

java - Why database contraints in HSQLDB are only checked during a commit when using transactions in Hibernate? -

-
i spotted odd behavior in hsql, seems when using database transactions database contraints not checked during sql inserts during sql commits , when transaction rollbacked not checked @ all. i have spring integration test: @runwith(springjunit4classrunner.class) @transactionconfiguration(defaultrollback=true, transactionmanager="transactionmanager") @transactional public class integrationtest { with test creates new entity instance , calls hibernate's persist on it. it works fine, when change defaultrollback false fails: caught exception while allowing testexecutionlistener [org.springframework.test.context.transaction.transactionaltestexecutionlistener@517a2b0] process 'after' execution test: method [public void myintegrationtest.test()], instance [myintegrationtest@546e61d5], exception [null] org.springframework.dao.dataintegrityviolationexception: not execute statement; sql [n/a]; constraint [null]; nested exception org.hibernate.exception.const...
Read more

visual studio - Installing Packages through Nuget - "Central Directory corrupt" -

-
i'm trying add package project using nuget (in vs2015). when click "install" button see downloading missing packages... at top of screen progress bar. after moment message replaced - an error occurred while trying restore packages: central directory corrupt. with "restore" button @ end same process. anyone have idea how fix this? edit 07/2017 a far easier method of solving issue visual studio re-download package - in visual studio open tools -> options . select nuget package manager . ensure both allow nuget download missing packages , automatically check missing packages during build in visual studio both ticked. click ok . in file explorer window navigate projects' "packages" folder. two options - figure out package @ fault described in original answer , delete its' folder or (if sure packages still available in nuget) delete package folders. back in visual studio build solution. visual s...
Read more