Commit graph

12 commits

Author SHA1 Message Date
Christopher Talib 1528c28d7e Changing Type to NodeType to avoid issues 2020-08-28 15:55:18 +02:00
Christopher Talib 7f83f720d8 save 2020-06-10 12:31:07 +02:00
Christopher Talib fe01a9240f Parsing shodan, not droppping DB
* Adding Certstream and Shodan matchers
* Insert or skip for new matchers (working without having to drop the DB
and not more duplicate matchers)
* Closing files after using them
* Adding Match model to schema and Node (for unmarshalling purposes)
2020-06-10 10:48:47 +02:00
Christopher Talib 9547aeea3f basic matching on simple target, no sending to dgraph 2020-05-27 12:05:53 +02:00
Christopher Talib 9fa5d13bf6 Full text search and indexing some keywords
Some of keywords are indexed and open for full text search, please refer
to the README for more details.

CertStream, Pastebin and Shodan are running as services and can be
searched.

Next steps: building the matcher and creating edges.
2020-05-20 10:03:28 +02:00
Christopher Talib 7163147a4f Pastebin nodes simple
Pastebin data is also sent to Dgraph and can be queried.
2020-05-19 10:10:42 +02:00
Christopher Talib b1ca4b3c5f Shodan in Dgraph, first part
Implementing first version for shodan node, missing yet some models, but
the overal approach works and can be queried in Ratel.
2020-05-18 16:09:04 +02:00
Christopher Talib cbdca52ab2 Simple linked model on certstream + better install instructions 2020-05-18 10:22:08 +02:00
Christopher Talib d0c8deae99 saving 2020-03-19 09:27:15 +01:00
Christopher Talib fb270a1b66 Mutating data without needing to get it back 2020-03-04 16:34:14 +01:00
Christopher Talib f61fe566a5 Basic connection to Dgraph DB
The first work and input to the graph db is set up in this work. It's
for the moment very basic and doesn't cover relations and only works for
certstream data.
2020-03-04 15:16:59 +01:00
Christopher Talib b2da64a9d7 Enh/modular arch 2020-02-25 10:05:31 +01:00