Christopher Talib
7785372e3a
Refactoring from utils to models
...
This work refactors saving and extracting function from the utils
package to the models package as it is a main component of the tool.
`utils` will take care of not related to models functions (such as
finding the files for example).
Also creating unique files for each type of source we are parsing.
2020-01-28 16:02:17 +01:00
Christopher Talib
01f3e3ca1e
Only saving objects that have an ID
2020-01-23 15:01:08 +01:00
Christopher Talib
2a04e01457
Remove error management as it break on empty values
2020-01-23 14:38:27 +01:00
Christopher Talib
7cbb7e9180
Cleaning and working write/read to kafka and saving objects
2020-01-23 14:36:24 +01:00
Christopher Talib
2548c19ca4
saving
2020-01-23 13:13:59 +01:00
Christopher Talib
64e1d3d7a4
Cleaning up non used functions
2020-01-22 16:33:07 +01:00
Christopher Talib
0d082374e9
Some temporal refactoring, saving domains and nodes
2020-01-22 15:45:25 +01:00
Christopher Talib
d33b293e7c
Read/write from Kafka, simpler structure with plain data and not pointers
2020-01-22 15:01:07 +01:00
Christopher Talib
48cc976595
Adding a consummer for Kafka, WIP
2020-01-21 16:50:50 +01:00
Christopher Talib
06f42fc472
Moving SendToKafka function to broker package
2020-01-17 14:02:52 +01:00
Christopher Talib
e9c065bcc8
Setting up connector to Kafka and sending consummed and formatted Nodes to Kafka
2020-01-16 15:56:57 +01:00
