[Cubicweb] datafeed

[Dimitri Papadopoulos Orfanos]

I've found a few words on datafeed in the Logilab blog about CubicWeb 3.11:
	http://www.cubicweb.org/blogentry/1512775

	A new 'datafeed' source was introduced, inspired by the
	soon to be deprecated datafeed cube. It needs polishing
	but sets the foundation for advanced semantic web
	applications that import content from others site using
	simple http request.

	A 'datafeed' source is associated to a parser that
	analyses the imported data and then creates/updates
	entities accordingly. There is currently a single parser
	in the core that imports CubicWeb-generated xml and needs
	to be configured with a mapping information that defines
	how relations are to be followed. It provides a viable
	alternative to 'pyrorql' sources. Other parsers to import
	RDF, RSS, etc should come soon.

 From what I gather datafeed can help import data from structured Web 
sites. It doesn't help importing data from files (we have to parse at 
least CSV, XML, DICOM files), does it?

In our application we repeatedly scan a directory for new files and data 
appended to existing files. Can datafeed help in that case? I'm thinking 
here about the "creates/updates entities accordingly" part of datafeed.

Le 04/12/2013 09:25, Dimitri Papadopoulos Orfanos a écrit :
> Dear all,
>
> I am interested in datafeed, a recent addition to the core CubicWeb
> libraries, because we are assigned the task to import data from
> different sources into our database.
>
> There is not much information on datafeed except for the source code. I
> wonder whether any of you CubicWeb wizards could:
> * explain the purpose and benefits of datafeed in one or two sentences,
> * give a few hints on the usage of datafeed.
>

-- 
Dimitri Papadopoulos
CEA/Saclay
I2BM, NeuroSpin
F-91191 Gif-sur-Yvette cedex, France