Commit graph

17 commits

Author SHA1 Message Date
Christopher Talib 65ad547860 Reimplementation of kafka with the docker compose + connection ok 2020-07-06 12:14:59 +02:00
Christopher Talib 9547aeea3f basic matching on simple target, no sending to dgraph 2020-05-27 12:05:53 +02:00
Christopher Talib d0c8deae99 saving 2020-03-19 09:27:15 +01:00
Christopher Talib f61fe566a5 Basic connection to Dgraph DB
The first work and input to the graph db is set up in this work. It's
for the moment very basic and doesn't cover relations and only works for
certstream data.
2020-03-04 15:16:59 +01:00
Christopher Talib cd43194873 First work for the dgraph connection + fixing some error logging 2020-03-02 16:27:51 +01:00
Christopher Talib 5bd0b8090b Update dependencies 2020-02-18 12:22:23 +01:00
Christopher Talib f4f82d9e1c Adding code and setting up elastic search 2020-02-17 12:08:49 +01:00
Christopher Talib 638216e8fa Implementing config variables in the application 2020-02-10 16:11:25 +01:00
Christopher Talib afd99c0a4d Adding balboa enrichment for domains and hostnames + documentation 2020-02-07 17:39:33 +01:00
Christopher Talib c2b59808be First implementation of shodan connector, but error on API key on streaming 2020-02-05 14:46:52 +01:00
Christopher Talib f0f6457dd3 go mod tidy 2020-02-04 10:35:39 +01:00
Christopher Talib e9c065bcc8 Setting up connector to Kafka and sending consummed and formatted Nodes to Kafka 2020-01-16 15:56:57 +01:00
Christopher Talib 6eaae99668 Extracting structures from CertStream
This work builds an extractor for the data in the CertStream in order to
save it. It builds itself from the previous work, so extensions and
flags can be added to the structures. The work in `utils` is basically a
big extractor for the data taking advantage of the JSONq library.

Currently, there is not refactoring and the "chains" are not saved
because they need additionnal computation which will come in a later
commit.
2020-01-15 14:36:53 +01:00
Christopher Talib 6064eed3e9 Fixing merge 2020-01-14 14:50:56 +01:00
Christopher Talib 7d741f4cf3 Basic read/write implementation with output in JSON 2020-01-14 14:49:14 +01:00
Robert Haist 8a7d4e1327 Update go.mod
changing the path name.
2020-01-14 09:56:46 +01:00
Christopher Talib b4e07b254a First commit with gitignore for the binary and initializing go modules 2020-01-14 09:43:12 +01:00