Christopher Talib
0e1e003ab2
First work on test for connection to CertStream
2020-01-26 17:27:40 +01:00
Christopher Talib
e4cc92e100
First work on Pastebin parser
2020-01-26 17:27:20 +01:00
Christopher Talib
a0d2761c4e
Adding RFC3339 times
2020-01-26 17:26:03 +01:00
Christopher Talib
01f3e3ca1e
Only saving objects that have an ID
2020-01-23 15:01:08 +01:00
Christopher Talib
2a04e01457
Remove error management as it break on empty values
2020-01-23 14:38:27 +01:00
Christopher Talib
7cbb7e9180
Cleaning and working write/read to kafka and saving objects
2020-01-23 14:36:24 +01:00
Christopher Talib
2548c19ca4
saving
2020-01-23 13:13:59 +01:00
Christopher Talib
64e1d3d7a4
Cleaning up non used functions
2020-01-22 16:33:07 +01:00
Christopher Talib
8ac9d5786b
Refactoring and setting clearer filenames in utils/
2020-01-22 15:49:52 +01:00
Christopher Talib
0d082374e9
Some temporal refactoring, saving domains and nodes
2020-01-22 15:45:25 +01:00
Christopher Talib
3bcafa4084
Adding .txt files to gitignore
2020-01-22 15:44:56 +01:00
Christopher Talib
d33b293e7c
Read/write from Kafka, simpler structure with plain data and not pointers
2020-01-22 15:01:07 +01:00
Christopher Talib
48cc976595
Adding a consummer for Kafka, WIP
2020-01-21 16:50:50 +01:00
Christopher Talib
06f42fc472
Moving SendToKafka function to broker package
2020-01-17 14:02:52 +01:00
Christopher Talib
e9c065bcc8
Setting up connector to Kafka and sending consummed and formatted Nodes to Kafka
2020-01-16 15:56:57 +01:00
Christopher Talib
e6cbfc6466
Changing IDs to stix compatible format
2020-01-16 12:06:03 +01:00
Christopher Talib
1b25c25aa7
Adding some configuration, flagging inputs as CertStream
2020-01-15 16:46:13 +01:00
Christopher Talib
1081e0c728
Full saving of CertStream data
...
This work saves the entires CertStream into JSON.
2020-01-15 16:07:11 +01:00
Christopher Talib
9bcc784ffd
Adding README with install instructions
2020-01-15 14:40:47 +01:00
Christopher Talib
6eaae99668
Extracting structures from CertStream
...
This work builds an extractor for the data in the CertStream in order to
save it. It builds itself from the previous work, so extensions and
flags can be added to the structures. The work in `utils` is basically a
big extractor for the data taking advantage of the JSONq library.
Currently, there is not refactoring and the "chains" are not saved
because they need additionnal computation which will come in a later
commit.
2020-01-15 14:36:53 +01:00
Christopher Talib
b7dce16c9e
Adding unpacking in JSON format, and types for certstream format
2020-01-14 16:31:57 +01:00
Christopher Talib
6064eed3e9
Fixing merge
2020-01-14 14:50:56 +01:00
Christopher Talib
7d741f4cf3
Basic read/write implementation with output in JSON
2020-01-14 14:49:14 +01:00
Robert Haist
1e8898b445
Update .gitignore
...
changing the bin name.
2020-01-14 09:57:08 +01:00
Robert Haist
8a7d4e1327
Update go.mod
...
changing the path name.
2020-01-14 09:56:46 +01:00
Christopher Talib
b4e07b254a
First commit with gitignore for the binary and initializing go modules
2020-01-14 09:43:12 +01:00
