Commit graph

  • e8f114edef Fix duplicated nodes in matcher aleph Christopher Talib 2020-08-28 15:55:43 +0200
  • 1528c28d7e Changing Type to NodeType to avoid issues Christopher Talib 2020-08-28 13:34:08 +0200
  • 84e4937f85 Major version update Christopher Talib 2020-08-24 16:25:49 +0200
  • 65ad547860 Reimplementation of kafka with the docker compose + connection ok Christopher Talib 2020-07-06 12:14:59 +0200
  • f161d60d2d Adding a small abstract to README Christopher Talib 2020-06-12 12:04:59 +0200
  • 7f83f720d8 save Christopher Talib 2020-06-10 12:31:07 +0200
  • 5d223c3886 Adding pastebin matching + demo IOC Christopher Talib 2020-06-10 11:32:56 +0200
  • fe01a9240f Parsing shodan, not droppping DB Christopher Talib 2020-06-10 10:48:47 +0200
  • 0234a4f50b Adding *.swp to gitignore" Christopher Talib 2020-06-10 10:47:39 +0200
  • 44bc03b51d Adding certstream matching on CN Christopher Talib 2020-06-08 12:58:07 +0200
  • 929222aff4 Parallel matching on multiple targets work Christopher Talib 2020-06-08 10:49:19 +0200
  • b26cc60d39 multiple search works (kinda) Christopher Talib 2020-06-03 16:20:40 +0200
  • ba0b011ce4 save Christopher Talib 2020-06-02 15:44:24 +0200
  • e533c2c335 updating matcher nodes works! Christopher Talib 2020-06-02 10:58:31 +0200
  • 3961e79062 Matcher logic and IOCs Christopher Talib 2020-05-29 11:32:55 +0200
  • 9547aeea3f basic matching on simple target, no sending to dgraph Christopher Talib 2020-05-27 12:05:53 +0200
  • 9fa5d13bf6 Full text search and indexing some keywords Christopher Talib 2020-05-20 10:03:28 +0200
  • 7163147a4f Pastebin nodes simple Christopher Talib 2020-05-19 10:10:42 +0200
  • b1ca4b3c5f Shodan in Dgraph, first part Christopher Talib 2020-05-18 16:09:04 +0200
  • cbdca52ab2 Simple linked model on certstream + better install instructions Christopher Talib 2020-05-18 10:22:08 +0200
  • 5dca0a0472 adding Dgraph explanantions Christopher Talib 2020-05-13 14:52:38 +0200
  • f0aa10a9d2 Adding docker-compose for dgraph Christopher Talib 2020-05-13 11:51:54 +0200
  • d0c8deae99 saving Christopher Talib 2020-03-19 09:27:15 +0100
  • fb270a1b66 Mutating data without needing to get it back Christopher Talib 2020-03-04 16:34:14 +0100
  • f61fe566a5 Basic connection to Dgraph DB Christopher Talib 2020-03-04 15:16:59 +0100
  • b72e82071d saving Christopher Talib 2020-03-02 17:06:28 +0100
  • cd43194873 First work for the dgraph connection + fixing some error logging Christopher Talib 2020-03-02 16:27:51 +0100
  • d761e824f3 Changing the plugin architecture for a modular architecture. Christopher Talib 2020-02-25 10:05:31 +0100
  • b2da64a9d7 Enh/modular arch Christopher Talib 2020-02-25 10:05:31 +0100
  • e87856b9a1 Removing print statements Christopher Talib 2020-02-20 14:53:18 +0100
  • 0f25d6d81c Prototype to domain filtering with Pharos filters Christopher Talib 2020-02-20 14:32:06 +0100
  • e7421931c2 Couple of quickfixes to allow run a dry installion (deactivating ES and balboa) Christopher Talib 2020-02-19 15:26:47 +0100
  • 56e0e52bb5 Cleaning up example config Christopher Talib 2020-02-19 10:03:49 +0100
  • 5bd0b8090b Update dependencies Christopher Talib 2020-02-18 12:22:23 +0100
  • 3a3637c847 Move RunIPFilters() to filters/main.go Christopher Talib 2020-02-18 12:21:39 +0100
  • f0a6715acd Adding elasticsearch configuration on README Christopher Talib 2020-02-17 12:10:27 +0100
  • f4f82d9e1c Adding code and setting up elastic search Christopher Talib 2020-02-17 12:08:49 +0100
  • 5b1bfbc195 Filters for IP and shodan Christopher Talib 2020-02-14 20:46:09 +0100
  • 1fc11e7a4e Adding all CIDR files in filters/data Christopher Talib 2020-02-14 12:01:50 +0100
  • 02a014262a Adding Akamai filters for data recieved in Shodan + allow deactivating Balboa search Christopher Talib 2020-02-14 11:36:47 +0100
  • e963633c89 Allowing the possiblity to activate or deactivate modules Christopher Talib 2020-02-14 11:30:59 +0100
  • bd3f108d12 Shodan ports in config Christopher Talib 2020-02-12 16:54:14 +0100
  • 638216e8fa Implementing config variables in the application Christopher Talib 2020-02-10 16:11:25 +0100
  • 7c5b2b714a Adding configuration documentation and the config file in the gitignore Christopher Talib 2020-02-10 14:40:33 +0100
  • e634636768 Fix readme Christopher Talib 2020-02-10 10:36:36 +0100
  • 40bfc4b01d Beautify readme Christopher Talib 2020-02-07 17:50:07 +0100
  • 2991f830bb Update README with info about Balboa queries Christopher Talib 2020-02-07 17:45:37 +0100
  • afd99c0a4d Adding balboa enrichment for domains and hostnames + documentation Christopher Talib 2020-02-07 17:39:33 +0100
  • 787e2c3d02 Creating balboa package Christopher Talib 2020-02-07 17:38:43 +0100
  • 01f7ae70b9 Renaming CertStreamWrapper to CertStreamRaw for more clarity Christopher Talib 2020-02-07 15:50:21 +0100
  • e38b05de66 Update README with more information on the nodes and edges connections Christopher Talib 2020-02-07 15:49:42 +0100
  • c7a52c527a Refactoring saving single value into a helper, adding meta names to main nodes and edges Christopher Talib 2020-02-07 15:27:14 +0100
  • 93f577cae9 Settting up more verbose logging with calling function and timestamp Christopher Talib 2020-02-07 14:52:29 +0100
  • 2813ab0e96 Cleaning up and and reorganizing the models package Christopher Talib 2020-02-06 17:13:19 +0100
  • cc87dab922 Cleaning up and and reorganizing the models package Christopher Talib 2020-02-06 17:13:19 +0100
  • b5caae0974 Shodan connector and saving up and running Christopher Talib 2020-02-06 17:01:37 +0100
  • a321b46d0f Adding chained items to parent object in certstream Christopher Talib 2020-02-05 15:57:30 +0100
  • c2b59808be First implementation of shodan connector, but error on API key on streaming Christopher Talib 2020-02-05 14:46:52 +0100
  • efde1a4a54 Building ID on certnode Christopher Talib 2020-02-04 10:58:56 +0100
  • 380e51229b Building nodes, certnode, and edges Christopher Talib 2020-02-04 10:35:18 +0100
  • 00bfb5eaaf First implementation of certnode Christopher Talib 2020-02-04 10:22:48 +0100
  • f0f6457dd3 go mod tidy Christopher Talib 2020-02-04 10:15:48 +0100
  • 8fc88b2694 Merge branch 'pastebin-poc' into 'master' Christopher Talib 2020-02-03 10:02:43 +0100
  • 0cd0faa6fa Working pastebin connector with parallel running with certstream Christopher Talib 2020-01-30 17:43:10 +0100
  • b9a2e73e33 Working version capturing CertStream saving raw, nodes and edges. Christopher Talib 2020-01-29 12:47:01 +0100
  • b9f0ac688c Removing extract.go file and refactoring the adhoc functions to files with name of the service Christopher Talib 2020-01-29 11:05:05 +0100
  • 668686fbab Saving edges and node from CertStream traffic. Christopher Talib 2020-01-29 10:03:52 +0100
  • 67aecd65c1 Saving edges and node from CertStream traffic. Christopher Talib 2020-01-29 10:03:52 +0100
  • de0c5bfe83 Setting up linking and and creating nodes already from the input source Christopher Talib 2020-01-28 23:52:24 +0100
  • 20f34c350a Moving SaveDomains to parser package Christopher Talib 2020-01-28 16:03:46 +0100
  • e458a327d6 Moving SaveDomains to parser package Christopher Talib 2020-01-28 16:03:46 +0100
  • e39cf58d39 Moving SaveDomains to parser package Christopher Talib 2020-01-28 16:03:46 +0100
  • 7785372e3a Refactoring from utils to models Christopher Talib 2020-01-28 16:00:56 +0100
  • 0e1e003ab2 First work on test for connection to CertStream Christopher Talib 2020-01-26 17:27:40 +0100
  • e4cc92e100 First work on Pastebin parser Christopher Talib 2020-01-26 17:27:20 +0100
  • a0d2761c4e Adding RFC3339 times Christopher Talib 2020-01-26 17:26:03 +0100
  • 01f3e3ca1e Only saving objects that have an ID Christopher Talib 2020-01-23 15:01:08 +0100
  • 2a04e01457 Remove error management as it break on empty values Christopher Talib 2020-01-23 14:38:27 +0100
  • 7cbb7e9180 Cleaning and working write/read to kafka and saving objects Christopher Talib 2020-01-23 14:36:24 +0100
  • 2548c19ca4 saving Christopher Talib 2020-01-23 13:13:59 +0100
  • 64e1d3d7a4 Cleaning up non used functions Christopher Talib 2020-01-22 16:33:07 +0100
  • 8ac9d5786b Refactoring and setting clearer filenames in utils/ Christopher Talib 2020-01-22 15:49:52 +0100
  • 0d082374e9 Some temporal refactoring, saving domains and nodes Christopher Talib 2020-01-22 15:45:25 +0100
  • 3bcafa4084 Adding .txt files to gitignore Christopher Talib 2020-01-22 15:44:56 +0100
  • d33b293e7c Read/write from Kafka, simpler structure with plain data and not pointers Christopher Talib 2020-01-22 15:01:07 +0100
  • 48cc976595 Adding a consummer for Kafka, WIP Christopher Talib 2020-01-21 16:50:50 +0100
  • 06f42fc472 Moving SendToKafka function to broker package Christopher Talib 2020-01-17 13:51:11 +0100
  • e9c065bcc8 Setting up connector to Kafka and sending consummed and formatted Nodes to Kafka Christopher Talib 2020-01-16 15:56:57 +0100
  • e6cbfc6466 Changing IDs to stix compatible format Christopher Talib 2020-01-16 12:06:03 +0100
  • 1b25c25aa7 Adding some configuration, flagging inputs as CertStream Christopher Talib 2020-01-15 16:46:13 +0100
  • 1081e0c728 Full saving of CertStream data Christopher Talib 2020-01-15 16:07:11 +0100
  • 9bcc784ffd Adding README with install instructions Christopher Talib 2020-01-15 14:40:47 +0100
  • 6eaae99668 Extracting structures from CertStream Christopher Talib 2020-01-15 14:36:53 +0100
  • b7dce16c9e Adding unpacking in JSON format, and types for certstream format Christopher Talib 2020-01-14 16:31:57 +0100
  • 6064eed3e9 Fixing merge Christopher Talib 2020-01-14 14:50:56 +0100
  • 7d741f4cf3 Basic read/write implementation with output in JSON Christopher Talib 2020-01-14 14:49:14 +0100
  • 1e8898b445 Update .gitignore Robert Haist 2020-01-14 09:57:08 +0100
  • 8a7d4e1327 Update go.mod Robert Haist 2020-01-14 09:56:46 +0100
  • b4e07b254a First commit with gitignore for the binary and initializing go modules Christopher Talib 2020-01-14 09:43:12 +0100