+4420 3290 2266


Project Haala


Feeding data File system, uploading and feeding files

There is the feed directory which the system periodically scans looking for files. The system reads the files, processes them and deletes. Tasks are used for this purpose with each task responsible for picking up a suitable file and importing data from it. For example, one of the tasks looks for files ending with labels.xml, imports text into a database and then deletes processed files.

Tasks importing data usually execute in 2 phases:

  1. FAKE phase checks if a file follows expected syntax and has all necessary dependencies. It behaves just as REAL phase but no data is imported. In case of an error the file will not be processed.
  2. REAL phase also does all the checks and feeds the data into the system.