Commit graph

9 commits

Author SHA1 Message Date
Christopher Talib fe01a9240f Parsing shodan, not droppping DB
* Adding Certstream and Shodan matchers
* Insert or skip for new matchers (working without having to drop the DB
and not more duplicate matchers)
* Closing files after using them
* Adding Match model to schema and Node (for unmarshalling purposes)
2020-06-10 10:48:47 +02:00
Christopher Talib 9fa5d13bf6 Full text search and indexing some keywords
Some of keywords are indexed and open for full text search, please refer
to the README for more details.

CertStream, Pastebin and Shodan are running as services and can be
searched.

Next steps: building the matcher and creating edges.
2020-05-20 10:03:28 +02:00
Christopher Talib b1ca4b3c5f Shodan in Dgraph, first part
Implementing first version for shodan node, missing yet some models, but
the overal approach works and can be queried in Ratel.
2020-05-18 16:09:04 +02:00
Christopher Talib e87856b9a1 Removing print statements 2020-02-20 14:53:18 +01:00
Christopher Talib 0f25d6d81c Prototype to domain filtering with Pharos filters 2020-02-20 14:32:06 +01:00
Christopher Talib 3a3637c847 Move RunIPFilters() to filters/main.go 2020-02-18 12:21:39 +01:00
Christopher Talib 5b1bfbc195 Filters for IP and shodan 2020-02-14 20:46:09 +01:00
Christopher Talib 1fc11e7a4e Adding all CIDR files in filters/data 2020-02-14 12:01:50 +01:00
Christopher Talib 02a014262a Adding Akamai filters for data recieved in Shodan + allow deactivating Balboa search 2020-02-14 11:36:47 +01:00