This new work implements the server and the loader in two different
binaries allowing the code while updating the IOC list.
It updates also the documentation to reflect the new changes.
* Adding Certstream and Shodan matchers
* Insert or skip for new matchers (working without having to drop the DB
and not more duplicate matchers)
* Closing files after using them
* Adding Match model to schema and Node (for unmarshalling purposes)
This work starts to build the matcher logic into styx. For the moment,
the goal is to define IOCs and load them when the Matcher plugin is
activated.
To implement: Then, the matcher will run periodic queries to different
types of nodes and index them to its one Matcher Dgraph Node. So be
targetting a specific IOCs, the user will be able to list the
observation that have been made to it.
Some of keywords are indexed and open for full text search, please refer
to the README for more details.
CertStream, Pastebin and Shodan are running as services and can be
searched.
Next steps: building the matcher and creating edges.
The first work and input to the graph db is set up in this work. It's
for the moment very basic and doesn't cover relations and only works for
certstream data.
