[Cubicweb] Wild idea to speed up repository loading

Sylvain Thénault sylvain.thenault at logilab.fr
Mon Jul 7 22:21:28 CEST 2014


On 07 juillet 22:11, Christophe de Vienne wrote:
> Hi all,

Hi Christophe,
 
> One of the reason the partial application reloading that is currently
> implemented in cubicweb is that loading a complex schema from a database
> can take quite some time.
> 
> If someday we switch to a complete reload (read: if we rely on pyramid
> to do so), the time to reload would be a regression.
> 
> I wonder if we could save the pickled schema, along with a timestamp
> corresponding the latest modification of the scheme.
> If so, before reading the whole schema from the database, we would only
> have to unpickle the schema from a local file : that would be faster
> wouldn't it ?
> 
> I will not experiment with this idea right now but if someone want to
> play with it I would love to hear about the results !

that's something I had in mind for a while but never took the time to play with
it. It would definitly be a huge speed-up, the biggest issue being when to
invalidate this cache.

-- 
Sylvain Thénault, LOGILAB, Paris (01.45.32.03.12) - Toulouse (05.62.17.16.42)
Formations Python, Debian, Méth. Agiles: http://www.logilab.fr/formations
Développement logiciel sur mesure:       http://www.logilab.fr/services
CubicWeb, the semantic web framework:    http://www.cubicweb.org



More information about the Cubicweb mailing list