[Cubicweb] Using fastimport

Christophe de Vienne christophe at unlish.com
Wed Jan 7 00:21:20 CET 2015


Just FYI, there is a memory leak somewhere.

I do batch insertions, the batch size is 250, and the more it goes, to
slowest it becomes, and the memory usage jump to several gigabytes (more
than 10G) after ~36000 insertions.

I don't have this problem with a classic create_entity.

Cheers,

Christophe

Le 07/01/2015 00:02, Christophe de Vienne a écrit :
> Also,
> 
> 3. Why does FlushController take a session and not a cnx ?
> 
> Le 06/01/2015 23:51, Christophe de Vienne a écrit :
>> Hi everyone,
>>
>> I am trying to use the fastimport module and have some questions.
>>
>> 1. Why are some deferred hooks sent to a CWWorkerTask ?
>>    Can I avoid that ?
>>
>> 2. Why is there a dependency on numpy ? It feels a bit heavy.
>>
>>
>> Cheers,
>>
>> Christophe
>>
> 

-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 473 bytes
Desc: OpenPGP digital signature
URL: <http://lists.cubicweb.org/pipermail/cubicweb/attachments/20150107/fdd86f05/attachment-0050.sig>


More information about the Cubicweb mailing list