vcswatch reports that
this package seems to have a new changelog entry (version
2.4.1-1, distribution
unstable) and new commits
in its VCS. You should consider whether it's time to make
an upload.
Here are the relevant commit messages:
commit 7f4a75fee68435cae787b51e574306e77744b768
Author: whotwagner <ilovemail@feedyourhead.at>
Date: Thu Sep 23 13:24:51 2021 +0200
Added config file for test-scripts and changed the kafka version to 2… (#954)
* Added config file for test-scripts and changed the kafka version to 2.13-2.8.1
* changed kafka-version for integrationtests
Co-authored-by: Wolfgang Hotwagner <wolfgang.hotwagner@ait.ac.at>
commit 0b8fa53e32403c27886236b321c87a75d1c0d2d9
Author: dITySoftware <56120276+dITySoftware@users.noreply.github.com>
Date: Tue Sep 14 16:26:26 2021 +0200
fixed persistence handling for ValueRangeDetector. (#948)
* fixed persistence handling for ValueRangeDetector.
* fixed persistence handling in ValueRangeDetector.
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
commit bddfc2862cbe0392808b50b657b5a09adb2e23bb
Author: hoeldg <66625424+hoeldg@users.noreply.github.com>
Date: Mon Sep 6 08:25:45 2021 +0200
VTD: Fixed bug when ETD used id_paths and VTD saved statistics (#945)
* VTD: Fixed a bug which appeared when the ETD used id_paths and the VTD saved statistics
* Update VariableTypeDetector.py
Fixed Issue
commit e3dc4e4c8d96f5fc82b443db6f828d0286e608b6
Author: whotwagner <ilovemail@feedyourhead.at>
Date: Fri Sep 3 16:15:50 2021 +0200
Development (#943)
* Added python3-statsmodels to Dockerfiles
This commit adds python3-statsmodels to the Dockerfiles(production,
testing) and makes sure that links for statsmodels are also available in
docker-images.
* fixed link-path for statsmodels in test-dockerfile
Co-authored-by: Wolfgang Hotwagner <wolfgang.hotwagner@ait.ac.at>
commit 33d2cb9adf92db00b61f9da6150ca35deed1b2de
Author: hoeldg <66625424+hoeldg@users.noreply.github.com>
Date: Thu Sep 2 14:42:22 2021 +0200
Fixed the bug, where the affected paths were set to None (#939)
commit c173aa5b15086b06f6399d1247191b865298b4c3
Author: Max Landauer <landauermax@users.noreply.github.com>
Date: Wed Sep 1 15:29:20 2021 +0200
Feature add json pretty (#937)
* Add id value to output
* Add id value to output
* Add pretty print param for json output
* Add pretty print param in documentation
commit df2d6104ff5d475cb95a20ce12cfbe6ead7cb957
Author: hoeldg <66625424+hoeldg@users.noreply.github.com>
Date: Wed Sep 1 13:05:00 2021 +0200
ETD: Slimed the persistency down (#934)
commit 7004b05e7e13bbdbe8386c3e7b925cbfb2d526e2
Author: hoeldg <66625424+hoeldg@users.noreply.github.com>
Date: Wed Sep 1 13:04:25 2021 +0200
VTD: Fixed a bug related to the persistency (#932)
commit 7ab2829bfdf2d80c4678bf9c1a2380c2cd0af61b
Author: hoeldg <66625424+hoeldg@users.noreply.github.com>
Date: Fri Aug 27 09:34:38 2021 +0200
Added the ID paths and values to the output (#928)
* Added the ID paths and values to the output
* Fixed DeepSourceIssues
* Fixed JenkinsIssues
commit 31b979c26ff4fe6fb35a5194b924d09658f6d3dd
Author: hoeldg <66625424+hoeldg@users.noreply.github.com>
Date: Thu Aug 26 16:21:37 2021 +0200
TSA: improved confidence calculation (#923)
* TSA: improved confidence calculation
* Update PathArimaDetector.py
PathArimaDetector: Improved the confidence calculation
* Fixed typo
commit 5708bcc57cacf0345d96e065484730e804f0a279
Author: hoeldg <66625424+hoeldg@users.noreply.github.com>
Date: Thu Aug 26 08:00:17 2021 +0200
ETD: Added the function get_event_type to standardize output of the f… (#926)
* ETD: Added the function get_event_type to standardize output of the following modules
* Fixed typos
* Fixed DeepSourceIssues
commit bc9eacaeda27deee4cd0c19e70b0fb479f118919
Author: hoeldg <66625424+hoeldg@users.noreply.github.com>
Date: Thu Aug 26 07:51:11 2021 +0200
VTD: Fixed bugs in the calculation of new values in discrete VT, smaller improvements of the output of the discrete type. (#922)
commit fb013b1e229872de32a72f5b71e79011c80e5b92
Author: hoeldg <66625424+hoeldg@users.noreply.github.com>
Date: Tue Aug 24 12:40:29 2021 +0200
PTSAD: Fixed a bug, which occurs, when the ETD stops saving the value… (#917)
* PTSAD: Fixed a bug, which occurs, when the ETD stops saving the values of one analyzed path
* Fixed DeepSourceIssues
* Fixed DeepSourceIssues
commit 37153d261d4c5b8ab2969de653c47e797ab1d898
Author: hoeldg <66625424+hoeldg@users.noreply.github.com>
Date: Tue Aug 24 11:01:48 2021 +0200
Update ducumentation (#915)
* Added the PathArimaDetector and updated the documentation.
* Fixed a typo
* Renamed some variables and revised the documentation
* Fixed some typos
commit fff2e3205e3be8577ddd16c80a761010b0965395
Author: hoeldg <66625424+hoeldg@users.noreply.github.com>
Date: Tue Aug 24 08:35:30 2021 +0200
Added a test to the VTD if values are stored in the ETD (#914)
commit c9bde33c2344ada93a28172fa5e73af50761c529
Author: hoeldg <66625424+hoeldg@users.noreply.github.com>
Date: Mon Aug 23 09:29:05 2021 +0200
Added the PathArimaDetector (#913)
* Added the PathArimaDetector
* Fixed DeepSourceIssues
* Fixed a typo
commit 4fae66b26feaf9daae058d6d45f626582f5b91e6
Author: hoeldg <66625424+hoeldg@users.noreply.github.com>
Date: Tue Aug 17 16:17:48 2021 +0200
VTD: Changed the parameter update_var_type_bool to learn_mode (#909)
commit 3e9c65b3c9f291a4ab264964417c13a39388bb53
Author: hoeldg <66625424+hoeldg@users.noreply.github.com>
Date: Tue Aug 17 12:59:41 2021 +0200
Refactored the output of the calculation of the time steps (#906)
* Refactored the output of the calculation of the time steps
* Fixed DeepSourceIssues
commit 0ef4edd0770ef2c0aa858c2055fab1ee660d9557
Author: hoeldg <66625424+hoeldg@users.noreply.github.com>
Date: Mon Aug 16 17:13:33 2021 +0200
TSA: Added functionality to discard arima models with too few log lines per time step. (#899)
Co-authored-by: 4cti0nfi9ure <16901151+4cti0nfi9ure@users.noreply.github.com>
commit 718b82dd3863d5fcbc52df3f05d26d85aedbca27
Author: hoeldg <66625424+hoeldg@users.noreply.github.com>
Date: Mon Aug 16 16:12:25 2021 +0200
Removed the persistation of the following moldues in the ETD (#898)
commit bc9288966ae5ef43f915a4929ae01fb6f0558ec8
Author: hoeldg <66625424+hoeldg@users.noreply.github.com>
Date: Mon Aug 16 16:10:38 2021 +0200
ETD: Fixed the problem when entries of the match_dictionary are not o… (#903)
* ETD: Fixed the problem when entries of the match_dictionary are not of type MatchElement
* Fixed a bug
commit 3205ccd90b5d4366e37cb9d1203d9daf4c442e19
Author: hoeldg <66625424+hoeldg@users.noreply.github.com>
Date: Mon Aug 16 15:48:41 2021 +0200
TSA: Fixed problem with varaible learn_mode (#904)
commit c4ac3a62c71ef04bee86676941817f6b27301293
Author: dITySoftware <56120276+dITySoftware@users.noreply.github.com>
Date: Wed Aug 11 10:22:34 2021 +0200
137 paths to json list (#867)
* added check_subpath to the NewMatchPathValueDetector.
* undid changes in NewMatchPathValueDetector.
* implemented list elements for NewMatchPathDetector, NewMatchPathValueDetector and ParserMatch.
* adapted all analysis components.
* fixed deepsource issues.
* fixed tests.
* changed YamlConfig.
* fixed unittests.
* undid changes.
* undid changes.
* fixed test and ParserMatch.
* fixed error.
* fixed error.
* fixed error.
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
commit 37a12777694c59d7ed092f242cf4cbc6eacd346e
Author: hoeldg <66625424+hoeldg@users.noreply.github.com>
Date: Mon Aug 9 15:17:02 2021 +0200
Tsa force period length (#890)
* TSA: Added the option to force the period length
* TSA: Fixed the output
* Fixed Deepsource issues
commit ccc806a8a7345ab0d7bfa44d3488a4b78a98b7a3
Author: dITySoftware <56120276+dITySoftware@users.noreply.github.com>
Date: Fri Aug 6 08:21:16 2021 +0200
fixed error where json data instead of array was parsed successfully. (#883)
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
commit 7e2ecdb91306065838e3e90ac158a588025f45a0
Author: whotwagner <ilovemail@feedyourhead.at>
Date: Fri Aug 6 08:19:49 2021 +0200
added akafka to docker-compose and modified the dockerfile in order t… (#885)
* added akafka to docker-compose and modified the dockerfile in order to set the userid
* add directories for docker-volumes to gitignore
* adds unix-domain-sockets to template_config
* adds RemoteControlSocket to prep-docker-compose.sh
Co-authored-by: Wolfgang Hotwagner <wolfgang.hotwagner@ait.ac.at>
commit ec08adac665e8b3a709d7dfb199e462b07f3a73a
Author: hoeldg <66625424+hoeldg@users.noreply.github.com>
Date: Fri Aug 6 08:17:00 2021 +0200
TSA: Automatic selection of the pause area of the ACF (#874)
* Added the automatic selection of the pause area of the ACF
* Fixed DeepSource Issue
commit 8c2647635f037be0f585ea7910d7b69ebef667eb
Author: Prajesh.pradhan <32845789+prajeshpradhan@users.noreply.github.com>
Date: Tue Jul 27 16:07:23 2021 +0545
Created docker-compose (#807) (#826)
* Created docker-compose (#807)
* Remove Command from Docker-Compose
commit 116574f05a5f4a453f39a3495ac4a4497a2e46df
Merge: 2872847d5 7ea590334
Author: Wolfgang Hotwagner <wolfgang.hotwagner@ait.ac.at>
Date: Mon Jul 26 12:25:34 2021 +0200
fixed merge-conflict
commit 2872847d5402612a0c8fa97184804d30b88a71e9
Author: 4cti0nfi9ure <16901151+4cti0nfi9ure@users.noreply.github.com>
Date: Fri Jul 23 17:41:34 2021 +0200
Update conf.py
commit 0bc5403a9a92495c79abdce404382ab7c2bf6f24
Author: 4cti0nfi9ure <16901151+4cti0nfi9ure@users.noreply.github.com>
Date: Fri Jul 23 17:40:49 2021 +0200
Update metadata.py
commit b0f075b763f0758cf172e755e75c49d17f4d3cb7
Author: Wolfgang Hotwagner <wolfgang.hotwagner@ait.ac.at>
Date: Fri Jul 23 16:19:39 2021 +0200
fixed Docstring missing in JsonModelElement.py
commit ac6bd77b626964d768e8c560c9ccd8f3b614d9a8
Author: Wolfgang Hotwagner <wolfgang.hotwagner@ait.ac.at>
Date: Fri Jul 23 16:18:29 2021 +0200
fixed Docstring missing in JsonModelElementTest.py
commit ecd40ecde27780c42690242f186cfc799b6819c7
Author: Wolfgang Hotwagner <wolfgang.hotwagner@ait.ac.at>
Date: Fri Jul 23 16:15:23 2021 +0200
fixed Blank line contains whitespace FLK-W293 in JsonModelElementTest.py
commit 76cfe4fbd32dc725d14ec3b12d91e25f805e75a9
Author: Wolfgang Hotwagner <wolfgang.hotwagner@ait.ac.at>
Date: Fri Jul 23 16:14:09 2021 +0200
fixed FLK-D209 in JsonModelElementTest.py
commit c0eae0cc4a1474ebd83b8ec78f69237a15fe7dba
Merge: 86f6ab568 b04a779f4
Author: whotwagner <ilovemail@feedyourhead.at>
Date: Fri Jul 23 16:00:26 2021 +0200
Merge branch 'main' into development
commit 86f6ab568cc4ed89ffac39cad68b1f6a92be1fe0
Author: dITySoftware <56120276+dITySoftware@users.noreply.github.com>
Date: Fri Jul 23 15:17:43 2021 +0200
fixed jsonConverterHandler-demo-config. (#837)
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
commit f6ac54c03acaaaaead8f36ed35008d2ef40cdbdc
Author: whotwagner <ilovemail@feedyourhead.at>
Date: Fri Jul 23 15:04:31 2021 +0200
Release 2.4.1 (#873)
This commit updates changelog, debian/changelog and metadata for release
2.4.1
Co-authored-by: Wolfgang Hotwagner <wolfgang.hotwagner@ait.ac.at>
commit ae726a283a08f467a6dc6cb843d67a17184f29e7
Author: dITySoftware <56120276+dITySoftware@users.noreply.github.com>
Date: Fri Jul 23 12:19:31 2021 +0200
renamed EMPTY_LIST to EMPTY_ARRAY (#872)
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
commit af84296d2d0717a484d9dde9490da6507d67fe9b
Author: dITySoftware <56120276+dITySoftware@users.noreply.github.com>
Date: Fri Jul 23 10:38:31 2021 +0200
139 added possiblity to parse array of arrays. (#871)
* added possiblity to parse array of arrays.
* fixed deepsource issues.
* fixed error.
* fixed error.
* fixed error.
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
commit 092e962e957e20d50fbbaa2886b32d1937e339aa
Author: whotwagner <ilovemail@feedyourhead.at>
Date: Fri Jul 23 09:46:59 2021 +0200
Feature docs (#822)
* docs: added eventhandler
* docs: added code-samples for eventhandlers
* docs: added link to kafka page
* docs: replaced analysis-pipeline image
* docs: fixed requirements.txt
* docs: removed requirements.txt from docs-path
* documented some analyzing components
* Update CONFIGURATION.rst
Co-authored-by: Wolfgang Hotwagner <wolfgang.hotwagner@ait.ac.at>
commit 427c44062017d74de59bd9732b1e1078212003ec
Author: dITySoftware <56120276+dITySoftware@users.noreply.github.com>
Date: Wed Jul 21 16:59:50 2021 +0200
133 Changed output of the JsonConverterHandler to be valid json data. (#836)
* Changed output of the JsonConverterHandler to be valid json data.
* fixed unittest.
* fixed unittest.
* fixed unittest.
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
commit dd5273ed6e26d94d6e854797ca50b39cd3ed9c48
Author: dITySoftware <56120276+dITySoftware@users.noreply.github.com>
Date: Wed Jul 21 16:58:11 2021 +0200
135 fix getting started (#838)
* fixed getting started tests.
* fixed SequenceDetector test.
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
commit 0c739597c2c0d08db86582125f820d342fded2ea
Author: dITySoftware <56120276+dITySoftware@users.noreply.github.com>
Date: Wed Jul 21 16:56:39 2021 +0200
131 added tests (#814)
* added code to find all configs.
* added config generation.
* extended test of available configs.
* added config files.
* added logs for the ApacheAccessParsingModel and fixed the Model up.
* added tests till AuditdParsingModel.
* added tests for SuricataEventParsingModel.
* added SuricataFastParsingModel tests.
* added tests for SyslogParsingModel
fixed ValueError in DTME.
* added tests for ApacheAccessModel and AudispdParsingModel.
* added more test of parsing models.
* fixed test.
* fixed dockerfile.
* fixed dockerfiles.
* fixed test.
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
commit add9a8ed48641422d5f58de9e717502937858087
Author: dITySoftware <56120276+dITySoftware@users.noreply.github.com>
Date: Wed Jul 21 16:56:33 2021 +0200
added slashes to some paths in the demo configs. (#839)
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
commit 1097234f1a15fda36e0161f946e7470f68e08dc9
Author: Max Landauer <landauermax@users.noreply.github.com>
Date: Wed Jul 21 16:42:42 2021 +0200
Documentation pca (#811)
* Add id value to output
* Add id value to output
* Add PCA detector documentation
commit 3905904712c33ba1585aaf9fc88cfa807ad57399
Author: dITySoftware <56120276+dITySoftware@users.noreply.github.com>
Date: Fri Jul 16 16:54:55 2021 +0200
fixed error. (#825)
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
commit 70671101045ddab1af4cb68af5df19ab934464af
Author: dITySoftware <56120276+dITySoftware@users.noreply.github.com>
Date: Thu Jul 15 14:35:44 2021 +0200
130 added testingwrapper. (#813)
* added testingwrapper.
* added line in Jenkinsfile.
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
commit a320dbb4b3ae5c11026ac9ec8a4725414537aab9
Author: whotwagner <ilovemail@feedyourhead.at>
Date: Thu Jul 15 14:35:05 2021 +0200
added simple tests for docker production images (#806)
Co-authored-by: Wolfgang Hotwagner <wolfgang.hotwagner@ait.ac.at>
commit 2e894f7b6f59633e4a1e37c2cacd9abcbc23a0e0
Author: dITySoftware <56120276+dITySoftware@users.noreply.github.com>
Date: Thu Jul 15 09:53:59 2021 +0200
129 add multiple analysis components to the demo configs (#803)
* added DebugMatchRule to the Demo configs.
* added ModuloTimeMatchRule to the demo configs.
* fixed ValueDependentModuloTimeMatchRule and added it to the demo configs.
* added IPv4InRFC1918MatchRule and ParallelMatchRule to the demo configs.
added EventGenerationMatchAction to the schemas.
* fixed typos.
* added ValueDependentDelegatedMatchRule to the demo configs.
* fixed unittest.
* added ValueListMatchRule and ValueRangeMatchRule to the demo configs.
* added StringRegexMatchRule and fixed outputs of demo configs.
* added DebugHistoryMatchRule to the demo configs.
* added SimpleMonotonicTimestampAdjust to the demo configs and fixed the Yaml for it.
* added SimpleMonotonicTimestampAdjust to the demo configs.
* fixed deepsource issues
* fixed unittests.
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
commit 17b70cef6287d9866606c9e12b06ef1361b64a61
Author: hoeldg <66625424+hoeldg@users.noreply.github.com>
Date: Wed Jul 14 17:09:57 2021 +0200
Fixed the falsely merged variable name (#810)
commit d4631cebb1e63ec792a0afb0759a442c28052b80
Author: dITySoftware <56120276+dITySoftware@users.noreply.github.com>
Date: Wed Jul 14 13:31:40 2021 +0200
added EMPTY_STRING option to the JsonModelElement. (#800)
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
commit 718f79291bc6efded7527cdbab6d204051e16a2c
Author: dITySoftware <56120276+dITySoftware@users.noreply.github.com>
Date: Tue Jul 13 14:08:09 2021 +0200
improved error message. (#799)
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
commit e3ba03b921c82f8f7b2a09e3c2f749440fe79020
Author: dITySoftware <56120276+dITySoftware@users.noreply.github.com>
Date: Tue Jul 13 14:07:11 2021 +0200
added missing characters to the ApacheAccessModel. (#798)
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
commit 7e34513f45f51352216fca622e873733c4d87303
Author: dITySoftware <56120276+dITySoftware@users.noreply.github.com>
Date: Tue Jul 13 14:03:03 2021 +0200
123 added allow_all_fields parameter and unittests for it. (#793)
* added allow_all_fields parameter and unittests for it.
* fixed deepsource issues.
* added input validation for allow_all_fields.
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
commit 11d1746f49f9ef72317fa81a36a845ce11594090
Author: dITySoftware <56120276+dITySoftware@users.noreply.github.com>
Date: Tue Jul 13 13:06:15 2021 +0200
124 timezone format (#794)
* added unittests for new timezone.
* added allowed format in the DTME.
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
commit b54040ee3b69c2b57179a4d5f340235e4d8d6e04
Author: dITySoftware <56120276+dITySoftware@users.noreply.github.com>
Date: Tue Jul 13 12:58:36 2021 +0200
119 fixed error with parsing floats in scientific notation with the JsonM… (#783)
* fixed error with parsing floats in scientific notation with the JsonModelElement.
* fixed json config.
* moved format_float out of get_match_element.
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
commit 1d0739ba8980f7216ac9765c3fd34c13ca32c9e1
Author: dITySoftware <56120276+dITySoftware@users.noreply.github.com>
Date: Tue Jul 13 09:47:16 2021 +0200
added code to allow empty objects with optional data. (#788)
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
commit a4581ff20c3ba059a8c9e65002bf02d00b86aa03
Author: dITySoftware <56120276+dITySoftware@users.noreply.github.com>
Date: Tue Jul 13 09:46:24 2021 +0200
121 fixed issue with paths in JsonModelElement. (#787)
* fixed issue with paths in JsonModelElement.
* implemented check to report unparsed atom if ALLOW_ALL is used with data with a type other than list or dict.
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
commit 80f95f6cf16cc7d28878ef6e03a61973c78ce096
Author: dITySoftware <56120276+dITySoftware@users.noreply.github.com>
Date: Tue Jul 13 09:44:17 2021 +0200
120 fixed error with \x encoded json data. (#784)
* fixed error with \x encoded json data.
* fixed error where \x was \\x.
* fixed deepsource issue.
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
commit 8c128d02557ffa9016a417d2199f74bbc9000a1c
Author: dITySoftware <56120276+dITySoftware@users.noreply.github.com>
Date: Tue Jul 13 09:35:44 2021 +0200
117 added solution for problem with output_event_handlers in JsonConverte… (#780)
* added solution for problem with output_event_handlers in JsonConverterHandler.
* fixed error.
* fixed declarations with training mode.
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
commit c7aeb3acd65e08bbbec82f40ee388084e7bbddfc
Author: hoeldg <66625424+hoeldg@users.noreply.github.com>
Date: Tue Jul 13 09:33:40 2021 +0200
Refined the ACF (#792)
Co-authored-by: Max Landauer <landauermax@users.noreply.github.com>
commit da91da6935fc9c5282512b232f5c83d0aca22db5
Author: hoeldg <66625424+hoeldg@users.noreply.github.com>
Date: Tue Jul 13 09:32:59 2021 +0200
Added the option to track on basis of the values of certain paths not only event types to the ETD (#790)
* Added the functionality of id_path_list in the ETD and added the parameters id_path_list, allow_missing_id and allowed_id_tuples.
* Fixed DeepSource Issues
* Fixed Issues
* Added counts, fixed merge issues
* Fixed issue
commit d14edeeb9d267e61b70ae1182c24e28d0f1307de
Author: hoeldg <66625424+hoeldg@users.noreply.github.com>
Date: Tue Jul 13 08:10:56 2021 +0200
Renamed parameters of the ETD (#786)
commit 37e42de4f97c078cead68a96d2fb082d10be4414
Author: dITySoftware <56120276+dITySoftware@users.noreply.github.com>
Date: Mon Jul 12 08:55:45 2021 +0200
fixed error where EMPTY_LIST and EMPTY_OBJECT could not be parsed from the yaml config. (#781)
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
commit 76c8efe5718cd625411300aca93a01cfe83a4bc7
Author: Max Landauer <landauermax@users.noreply.github.com>
Date: Fri Jul 2 11:02:55 2021 +0200
Feature entropydetector (#776)
* Add id value to output
* Add id value to output
* Add entropy detector
* Add test for entropy detector
* Add documentation
* Fix deepsource issues
* Fix deepsource issues
* Fix yaml config test
* Update EntropyDetectorTest.py
Fix typos
commit 61059874a30e2411d66f933165e48d407e3625dc
Author: Max Landauer <landauermax@users.noreply.github.com>
Date: Tue Jun 29 10:53:12 2021 +0200
Feature charset detector (#773)
* Add id value to output
* Add id value to output
* Add charset detector
* Add test for charset detector
* Add documentation for charset detector
* Fix typo
* Fix deepsource issues
* Fix yaml unit test
commit 6f9038a690f13ecf92b307a2a23a68ca596388c6
Author: Max Landauer <landauermax@users.noreply.github.com>
Date: Mon Jun 28 13:07:39 2021 +0200
Feature valuerangedetector (#772)
* Add id value to output
* Add id value to output
* Add value range detector
* Fix deepsource issues
* Fix deepsource issues
* Fix deepsource issues
* Fix test number in test
commit 9775357f23a83f20ded37f0e64de55a161a30c75
Author: hoeldg <66625424+hoeldg@users.noreply.github.com>
Date: Mon Jun 28 12:08:52 2021 +0200
Fixed the bug (#762)
commit ecf18100ba650b6b8caaa596f2020e43e0c2ae78
Author: hoeldg <66625424+hoeldg@users.noreply.github.com>
Date: Mon Jun 21 09:55:09 2021 +0200
TSA: Added variables (#768)
* Added the variables acf_pause_area and num_periods_tsa_ini.
* Fixed Deepsource issues, adapted the docs
commit 16ef8a7407fa2d0a4af4c289f2bf9110db7dfc16
Author: hoeldg <66625424+hoeldg@users.noreply.github.com>
Date: Mon Jun 21 09:53:41 2021 +0200
TSA persistency_id (#767)
* Added persistency_id
* Added the variables acf_pause_area and num_periods_tsa_ini to the TSA
* Added the variables in the docu and extended the persistency to load persistencies generated with build_sum_over_values
* TSA: Removed the variables.
commit 46e13b582a477d09547e4a106d893cff39d68b22
Author: dITySoftware <56120276+dITySoftware@users.noreply.github.com>
Date: Mon Jun 21 07:51:13 2021 +0200
added unittest for EMPTY_LIST and EMPTY_OBJECT. (#765)
* added unittest for EMPTY_LIST and EMPTY_OBJECT.
* added comment.
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
commit 1e48b309eef4d6adf58f4b374bbdc54f314447e3
Author: dITySoftware <56120276+dITySoftware@users.noreply.github.com>
Date: Mon Jun 21 07:48:47 2021 +0200
fixed encoding error. (#763)
* fixed encoding error.
* converted file to unix and added testline.
* fixed encoding errors.
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
commit 5951053f25577827a84544636fc5db6e0b135830
Author: whotwagner <ilovemail@feedyourhead.at>
Date: Mon Jun 21 07:46:30 2021 +0200
Fix systemd script (#758)
* set version-string to 2.4.1-dev
* set absolut paths for binaries in systemd-script
Co-authored-by: Wolfgang Hotwagner <wolfgang.hotwagner@ait.ac.at>
commit b689f99bbca7223decd9c51223fa9c39962271da
Author: dITySoftware <56120276+dITySoftware@users.noreply.github.com>
Date: Mon Jun 14 07:07:56 2021 +0200
114 fixed encoding errors when reading yaml configs. (#756)
* fixed encoding errors when reading yaml configs.
* fixed deepsource issue.
* fixed config.
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
commit 5e361a0c228d89d8138a6eb3dc23e73142b2043a
Author: dITySoftware <56120276+dITySoftware@users.noreply.github.com>
Date: Thu Jun 10 10:29:10 2021 +0200
113 fixed unicode error in JsonME (#754)
* added tests and fixed UnicodeDecodeError.
* fixed config.
* removed comment.
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
commit e603bf61630009312eb119032fec2a47c3512d86
Author: dITySoftware <56120276+dITySoftware@users.noreply.github.com>
Date: Wed Jun 9 07:54:22 2021 +0200
fixed deepsource issues. (#752)
* fixed deepsource issues.
* fixed deepsource issues.
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
commit edb25ac6d4f3a4e81de684b6816e90ba964959d1
Author: whotwagner <ilovemail@feedyourhead.at>
Date: Tue Jun 8 08:07:02 2021 +0200
Fix ci and docs (#750)
* removed unclean merge from docs/Configuration.rst
* fix for race-condition in cleanup of ci-pipeline
Co-authored-by: Wolfgang Hotwagner <wolfgang.hotwagner@ait.ac.at>
commit 29ac5f371ef3bf9f14a977ea806459e516dd6806
Author: dITySoftware <56120276+dITySoftware@users.noreply.github.com>
Date: Tue Jun 8 08:05:28 2021 +0200
111 fixed handling of json objects. (#749)
* fixed handling of json objects.
* fixed error.
* fixed error.
* fixed deepsource issues.
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
commit ee5f55ba84e4b7d40cbd986355e5ae12c86aa42f
Author: hoeldg <66625424+hoeldg@users.noreply.github.com>
Date: Tue Jun 8 08:05:11 2021 +0200
Fixed a bug in JsonModelElement (#748)
commit 443de52d768892ce19831d4c7d7c9052f987d276
Merge: 5c4fddf5a f1a0fb477
Author: Wolfgang Hotwagner <wolfgang.hotwagner@ait.ac.at>
Date: Mon Jun 7 16:20:36 2021 +0200
Merge remote-tracking branch 'upstream/main' into development
commit 5c4fddf5a6fcc7b49bedcdfaa1e99d4979f5650d
Author: whotwagner <ilovemail@feedyourhead.at>
Date: Mon Jun 7 11:55:03 2021 +0200
prepared aminer for V2.4.0 (#745)
Co-authored-by: Wolfgang Hotwagner <wolfgang.hotwagner@ait.ac.at>
commit a681290613143b94b869d57570f1569549c96d15
Author: whotwagner <ilovemail@feedyourhead.at>
Date: Fri Jun 4 17:53:13 2021 +0200
Main merge (#742)
* Development (#595)
* Added the variables min_values_cors_thres and new_vals_alarm_thres
* Fixed DeepSource-issue
* Implemented the chisquare test and added the parameters used_homogeneity_test and alpha_chisquare_test
* Fixed DeepSource-issues
* Add EventSequenceDetector
* Fix deepsource issues
* Fix deepsource issues
* Add unit test for EventSequenceDetector
* Fix deepsource issues.
* Fix deepsource issues.
* Remove print statement.
* Removed the prints and fixed typos
* Refactoring of the VTD-output
* Fixed DeepSource-issues
* Fixed DeepSource-issue
* Add frequency detector
* Fix deepsource issues
* Fix deepsource issues
* Fix deepsource issues
* Fix deepsource issues
* Fix confidence_factor
* Fixed warnigs due to files in Persistency-Directory
* fixed acl-problems in dockerfile and autocreate /var/lib/aminer/log
* added simple test for dockercontainer
* negate result of the timeout-command. 1 is okay. 0 must be an error
* added bullseye-tests
* make tmp-dir in debian-bullseye-test and debian-buster-test unique
* fixed various deepsource-issues
* added changes to changelog and modified version-string
* modified openjdk to work with bullseye
* Restructured some output and added a confidence value for messages related to anomalies
* fixed debian-changelog and removed changelog from /usr/share/doc/aminer
* Improve test documentation
* Fix deepsource issues
* Fix deepsource issues
* updated kafka download link.
* Fix deepsource issues
* Fix deepsource issues
* fixed kafka-version in coverage-tests
* Disabled Coverage-Test
Due to problems with kafka, the coverage-tests were temporarily
disabled.
* renamed AMiner to aminer or Aminer.
* fixed issues.
* removed link.
* added testing manifest to Readme.
* Refined the ouptut of the VCD
* fixed variable names.
* Fixed Deepsource-issues
* Fixed Deepsource issues
* Fixed Deepsource issue
* renamed AMiner to aminer or Aminer.
* fixed issues.
* removed link.
* fixed the warning in the VCD
* fixed the warning in the VCD
* Fixed the Warning in the VTD
* Fixed the method pick_cor_match_disc_vals
* added close function to LogStream.
* Changed the unit-test for the function matchDiscVals
* Add a query in the VCD to check if the ETD skipped the currently processed line
* Changed the variable w_rel_bt_results into w_rel_ht_results
* 007 yaml kafka event handler (#446)
* added KafkaEventHandler to template_config.yml
* added kafka client config.
* added KafkaEventHandler to template_config.py and template_config.yml.
* fixed kafka config path.
* fixed deepsource issues.
* fixed errors in template config.
* fixed error in template_config.
* added KafkaEventHandler to suppress_config.yml.
* renamed kafka_client.conf to kafka-client.conf.
* fixed error with KafkaEventHandler in YamlConfig.
* fixed errors in kafka-client.conf
* changed kafka topic for yaml tests.
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
* removed kafka-client.conf in unittest script.
* removed kafka-client.conf in unittest script. (#447)
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
* make wiki-tests branch-dependent
* fixed error in multiple detectors and added unittest.
* fixed errors.
* fixed error.
* added flag to mute persistence_id warnings in tests.
* fixed deepsource issues.
* fixed error.
* 009 specify yml remove imports (#451)
* implemented first version of new yaml schema validation. Analysis validation and EventHandler Validation is still missing.
* implemented EventHandler validation.
* fixed error.
* implemented AnalysisValidationSchema.
* fixed AnalysisValidationSchema.
* specified ParserValidationSchema.
* specified EventHandlerValidationSchema.
* fixed default values for EventHandler and Parser.
* specified Analysis schemas.
* specified Analysis Schemas.
* fixed skipped deepsource issues.
* removed imports from analysis/__init__.py.
* fixed imports in AnalysisComponentsPerformanceTest.
* removed analysis/__init__.py.
* fixed typo.
* fixed analysis import errors in configs.
* fixed errors in AnalysisChild.
* fixed error.
* fixed up aminer.events imports in all classes.
* fixed aminer.event imports.
* fixed import error in aminer.py.
* added __init__.py.
* fixed deepsource issues.
* removed imports from input/__init__.py.
* removed util/__init__.py.
* fixed typo.
* fixed typo.
* fixed import error.
* removed parsing/__init__.py.
* fixed error in yaml.
* fixed yaml error.
* fixed import error.
* fixed deepsource issues.
* specified integer values and added comments.
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
* Add documentation for params in ESD. (#455)
* fixed pr template. (#457)
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
* 013 multiline support (#459)
* added eol_sep parameter to the ByteStreamLineAtomizer.
* implemented json_format parameter.
* added json_format for multiline json support.
* fixed deepsource issues.
* fixed deepsource issues.
* fixed deepsource issues
* added warning if invalid json is found.
* added line number to warning.
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
* changed all shutil.chown to os.chown without using dir_fd. (#440)
* changed all shutil.chown to os.chown without using dir_fd.
* secured logging with dir_fd and follow_symlinks=False.
* fixed logging code in TestBase.
* fixed errors and moved imports to the top of the file.
* fixed deepsource issues.
* fixed error in TestBase.
* changed os.makedirs to os.mkdir and used dir_fd.
* fixed security issues.
* opened persistence_dir in initialize loggers.
* removed wrong import.
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
* 010 add kafka event handler to integration test2 (#456)
* added KafkaEventHandler to the integration test 2.
* renamed hostname in integration test.
* fixed indentation.
* fixed indentation error.
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
* fixed mail tests. (#458)
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
* 014 fix wiki tests (#465)
* extended the Getting Started Tests.
* extended try it out wiki tests.
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
* 015 add tests for esd efd (#468)
* added default value to target_path_list in EFD and ESD.
* added EFD to the demo configs.
* added the ESD to the aminer demo.
* added ESD and EFD to AnalysisChild.
* added performance tests for the ESD and EFD.
* fixed unittests.
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
* fixed error in TryItOut test. (#469)
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
* fixed encoding errors. (#471)
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
* Fix: too many open directory-handles (#472)
This patch fixes a problem with too many open file-handles. This problem
occurs with open directory-handles of resource-files.
Co-authored-by: Wolfgang Hotwagner <wolfgang.hotwagner@ait.ac.at>
* fixed encoding error. (#473)
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
* added sync_wait_time parameter. (#484)
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
* 020 create elasticsearch demo (#476)
* added consume_data parameter to the DelimitedDataModelElement.
* converted all tabs in Jenkinsfile to spaces.
* added consume_delimiter to yaml.
* fixed configs.
* added unfinished version of JsonModelElement.
* finished JsonModelElement.
* renamed optional_key_identifier to optional_key_prefix.
* fixed deepsource issues.
* fixed error.
* added first unittest for JsonModelElement.
* created unittests for JsonModelElement.
* fixed deepsource issues.
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
* 027 fix dev tests (#491)
* fixed testingwrapper.
* extended usage string.
* fixed runAminerElasticsearchDemo.sh.
* renamed elasticsearch to jsoninput.
* fixed error in test.
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
* 028 fix dev (#495)
* renamed config in aminerJsonInputDemo.
* changed wrong path.
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
* 022 check4updates (#482)
* added check4updates parameter.
* renamed check4updates to check.
* added installation of urllib3 to all dockerfiles.
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
* 031 json parsing (#502)
* added DetectionTimestamp to json output.
* fixed unittests.
* fixed unittests.
* fixed KafkaEventHandlerTest.
* fixed testingwrapper.
* fixed runAminerElasticsearchDemo.sh
* undid changes in testingwrapper.
* resolved conflicts
* fixed kafka tests.
* fixed encoding error in ByteStreamLineAtomizer.
* fixed json error when key does not exist.
* added unittest to JsonModelElementTest.
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
* changed default value of verbose to True. (#485)
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
* 030 improve error output yaml (#501)
* added DetectionTimestamp to json output.
* fixed unittests.
* fixed unittests.
* fixed KafkaEventHandlerTest.
* fixed testingwrapper.
* fixed runAminerElasticsearchDemo.sh
* undid changes in testingwrapper.
* resolved conflicts
* fixed kafka tests.
* added filter to error output in yaml.
* removed multiple outputs of yaml errors.
* fixed unittest.
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
* 035 fix suspend mode test (#507)
* added DetectionTimestamp to json output.
* fixed unittests.
* fixed unittests.
* fixed KafkaEventHandlerTest.
* fixed testingwrapper.
* fixed runAminerElasticsearchDemo.sh
* undid changes in testingwrapper.
* resolved conflicts
* fixed kafka tests.
* fixed suspend mode tests.
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
* 026 detection timestamp (#490)
* added DetectionTimestamp to json output.
* fixed unittests.
* fixed unittests.
* fixed KafkaEventHandlerTest.
* fixed testingwrapper.
* fixed runAminerElasticsearchDemo.sh
* undid changes in testingwrapper.
* resolved conflicts
* fixed Kafka output of integration test.
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
* 029 no args test (#496)
* added DetectionTimestamp to json output.
* fixed unittests.
* fixed unittests.
* fixed KafkaEventHandlerTest.
* fixed testingwrapper.
* fixed runAminerElasticsearchDemo.sh
* undid changes in testingwrapper.
* resolved conflicts
* removed args from apacheModel in template_config.
* fixed kafka tests.
* fixed kafka tests.
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
* 032 test whitespace constant (#503)
* added DetectionTimestamp to json output.
* fixed unittests.
* fixed unittests.
* fixed KafkaEventHandlerTest.
* fixed testingwrapper.
* fixed runAminerElasticsearchDemo.sh
* undid changes in testingwrapper.
* resolved conflicts
* fixed kafka tests.
* changed test to check WHITESPACE usage.
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
* 034 empty validation schemas (#506)
* added DetectionTimestamp to json output.
* fixed unittests.
* fixed unittests.
* fixed KafkaEventHandlerTest.
* fixed testingwrapper.
* fixed runAminerElasticsearchDemo.sh
* undid changes in testingwrapper.
* resolved conflicts
* fixed kafka tests.
* extended schemas to check if strings are empty.
* fixed names in demo configs.
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
* 036 New JSON Implementation + Tests (#511)
* added DetectionTimestamp to json output.
* fixed unittests.
* fixed unittests.
* fixed KafkaEventHandlerTest.
* fixed testingwrapper.
* fixed runAminerElasticsearchDemo.sh
* undid changes in testingwrapper.
* resolved conflicts
* fixed kafka tests.
* implemented JsonStateMachine to validate json input.
* extended json demo and added tests if they work properly.
* fixed Deepsource issues.
* fixed error in json parsing.
* fixed deepsource issue.
* fixed Deepsource issues.
* fixed deepsource issues.
* added more examples for json processing.
* fixed error in JsonStateMachine.
* added max_line_length to json_format.
* added unittests for hex_machine.
* added unittests for the ByteStreamLineAtomizer and JsonStateMachine.
* added unittests for the hex_machine and utf8_machine.
* added unittests for the constant_machine.
* added tests for the numbers_machine.
* added array_machine tests.
* added tests for object_machine and json_machine.
* fixed up JsonStateMachine.
* removed duplicate tests from aminerJsonInputDemo.
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
* 021 specify log resource list (#481)
* specified types of LogResourceList.
* fixed unittest.
* fixed deepsource issues.
* fixed regex.
* added more examples.
* added error messages for test24.
* fixed deepsource issues.
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
Co-authored-by: Max Landauer <landauermax@users.noreply.github.com>
* 025 specify base schema (#489)
* specified BaseSchema.py.
* fixed testingwrapper.
* undid changes in testingwrapper.
* fixed Deepsource issues.
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
Co-authored-by: Max Landauer <landauermax@users.noreply.github.com>
* 040 howto tests (#524)
* added DetectionTimestamp to json output.
* fixed unittests.
* fixed unittests.
* fixed KafkaEventHandlerTest.
* fixed testingwrapper.
* fixed runAminerElasticsearchDemo.sh
* undid changes in testingwrapper.
* resolved conflicts
* fixed kafka tests.
* implemented Tests for HowTo FrequencyDetector and SequenceDetector.
* added tests for wiki HowTo MissingMatchPathValueDetector.
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
* 045 hotfix tests (#536)
* added DetectionTimestamp to json output.
* fixed unittests.
* fixed unittests.
* fixed KafkaEventHandlerTest.
* fixed testingwrapper.
* fixed runAminerElasticsearchDemo.sh
* undid changes in testingwrapper.
* resolved conflicts
* fixed kafka tests.
* fixed Test.
* fixed suspendModeTest
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
* Fix allow multiple values per id path
* 046 hotfix2 (#537)
* added DetectionTimestamp to json output.
* fixed unittests.
* fixed unittests.
* fixed KafkaEventHandlerTest.
* fixed testingwrapper.
* fixed runAminerElasticsearchDemo.sh
* undid changes in testingwrapper.
* resolved conflicts
* fixed kafka tests.
* fixed errors in HowTo tests.
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
* 039 json me error output (#520)
* added DetectionTimestamp to json output.
* fixed unittests.
* fixed unittests.
* fixed KafkaEventHandlerTest.
* fixed testingwrapper.
* fixed runAminerElasticsearchDemo.sh
* undid changes in testingwrapper.
* resolved conflicts
* fixed kafka tests.
* fixed JsonModelElement error and specified output in the VerboseUnparsedAtomHandler.
* extended sleep time in Suspend mode test.
* fixed JsonModelElement when key is missing.
* fixed Deepsource issues.
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
* 037 file permissions (#518)
* added DetectionTimestamp to json output.
* fixed unittests.
* fixed unittests.
* fixed KafkaEventHandlerTest.
* fixed testingwrapper.
* fixed runAminerElasticsearchDemo.sh
* undid changes in testingwrapper.
* resolved conflicts
* fixed kafka tests.
* fixed permissions.
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
* 041 rewrite any byte dme (#526)
* added DetectionTimestamp to json output.
* fixed unittests.
* fixed unittests.
* fixed KafkaEventHandlerTest.
* fixed testingwrapper.
* fixed runAminerElasticsearchDemo.sh
* undid changes in testingwrapper.
* resolved conflicts
* fixed kafka tests.
* rewrote unittests for the AnyByteDME.
* fixed Deepsource issues.
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
* 033 rewrite FixedDME (#517)
* added DetectionTimestamp to json output.
* fixed unittests.
* fixed unittests.
* fixed KafkaEventHandlerTest.
* fixed testingwrapper.
* fixed runAminerElasticsearchDemo.sh
* undid changes in testingwrapper.
* resolved conflicts
* fixed kafka tests.
* changed test to check WHITESPACE usage.
* added new testcase design for FixedDME.
* rewrote some unittests for the FixedDME.
* finished rewriting unittests for the FixedDME.
* fixed Deepsource issues.
* added unittests for simple methods of FixedDME.
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
* 042 rewrite base64 me tests (#530)
* added DetectionTimestamp to json output.
* fixed unittests.
* fixed unittests.
* fixed KafkaEventHandlerTest.
* fixed testingwrapper.
* fixed runAminerElasticsearchDemo.sh
* undid changes in testingwrapper.
* resolved conflicts
* fixed kafka tests.
* changed test to check WHITESPACE usage.
* added new testcase design for FixedDME.
* rewrote some unittests for the FixedDME.
* finished rewriting unittests for the FixedDME.
* fixed Deepsource issues.
* added unittests for simple methods of FixedDME.
* added some unittests to the Base64 Model Element.
* Rewrote unittests for the Base64StringModelElement.
* fixed Deepsource issues.
* fixed unittest without exact length.
* added performance test and reimplemented the Base64StringModelElement.
* fixed Deepsource issues.
* fixed Deepsource issues.
* fixed Deepsource issues.
* fixed Deepsource issues.
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
* 038 yaml duplicate ids (#519)
* added DetectionTimestamp to json output.
* fixed unittests.
* fixed unittests.
* fixed KafkaEventHandlerTest.
* fixed testingwrapper.
* fixed runAminerElasticsearchDemo.sh
* undid changes in testingwrapper.
* resolved conflicts
* fixed kafka tests.
* added checks in YamlConfig if id was used multiple times for Analysis, Parser and EventHandlers.
* fixed Deepsource issues.
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
* 047 base64 (#550)
* added DetectionTimestamp to json output.
* fixed unittests.
* fixed unittests.
* fixed KafkaEventHandlerTest.
* fixed testingwrapper.
* fixed runAminerElasticsearchDemo.sh
* undid changes in testingwrapper.
* resolved conflicts
* fixed kafka tests.
* added check in Base64StringModelElement if data is encoded utf-8.
* commented changes.
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
* 044 json demos (#535)
* added DetectionTimestamp to json output.
* fixed unittests.
* fixed unittests.
* fixed KafkaEventHandlerTest.
* fixed testingwrapper.
* fixed runAminerElasticsearchDemo.sh
* undid changes in testingwrapper.
* resolved conflicts
* fixed kafka tests.
* fixed JsonModelElement error and specified output in the VerboseUnparsedAtomHandler.
* extended sleep time in Suspend mode test.
* fixed JsonModelElement when key is missing.
* fixed Deepsource issues.
* added special key ALLOW_ALL for JsonModelElement.
* fixed zero start handling of the JsonStateMachine.
* fixed errors in JSON input data handling and JsonStateMachine.
* fixed data.
* created first config for elastic.log and fixed more errors.
* finished json-elastic-demo.yml.
* added config for eve.json and fixed more JSON parsing errors.
* fixed more errors.
* added config for journal.log.
* added wazuh config.
* added logging to the JsonModelElement.
* added unittest for JsonModelElement with different key orders.
* fixed unittests.
* fixed JsonModelElement.
* fixed unittest.
* fixed runAminerJsonInputDemo and added runJsonDemo script.
* added Json Tests to Jenkinsfile and testingwrapper.
* removed debug outputs.
* fixed Deepsource issues.
* fixed Deepsource issues.
* fixed json demo configs.
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
* HOTFIX JENKINSFILE (#556)
* added DetectionTimestamp to json output.
* fixed unittests.
* fixed unittests.
* fixed KafkaEventHandlerTest.
* fixed testingwrapper.
* fixed runAminerElasticsearchDemo.sh
* undid changes in testingwrapper.
* resolved conflicts
* fixed kafka tests.
* fixed JsonModelElement error and specified output in the VerboseUnparsedAtomHandler.
* extended sleep time in Suspend mode test.
* fixed JsonModelElement when key is missing.
* fixed Deepsource issues.
* added special key ALLOW_ALL for JsonModelElement.
* fixed zero start handling of the JsonStateMachine.
* fixed errors in JSON input data handling and JsonStateMachine.
* fixed data.
* created first config for elastic.log and fixed more errors.
* finished json-elastic-demo.yml.
* added config for eve.json and fixed more JSON parsing errors.
* fixed more errors.
* added config for journal.log.
* added wazuh config.
* added logging to the JsonModelElement.
* added unittest for JsonModelElement with different key orders.
* fixed unittests.
* fixed JsonModelElement.
* fixed unittest.
* fixed runAminerJsonInputDemo and added runJsonDemo script.
* added Json Tests to Jenkinsfile and testingwrapper.
* removed debug outputs.
* fixed Deepsource issues.
* fixed Deepsource issues.
* fixed json demo configs.
* fixed jenkinsfile
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
* HOTFIX 2 (#559)
* added DetectionTimestamp to json output.
* fixed unittests.
* fixed unittests.
* fixed KafkaEventHandlerTest.
* fixed testingwrapper.
* fixed runAminerElasticsearchDemo.sh
* undid changes in testingwrapper.
* resolved conflicts
* fixed kafka tests.
* fixed JsonModelElement error and specified output in the VerboseUnparsedAtomHandler.
* extended sleep time in Suspend mode test.
* fixed JsonModelElement when key is missing.
* fixed Deepsource issues.
* added special key ALLOW_ALL for JsonModelElement.
* fixed zero start handling of the JsonStateMachine.
* fixed errors in JSON input data handling and JsonStateMachine.
* fixed data.
* created first config for elastic.log and fixed more errors.
* finished json-elastic-demo.yml.
* added config for eve.json and fixed more JSON parsing errors.
* fixed more errors.
* added config for journal.log.
* added wazuh config.
* added logging to the JsonModelElement.
* added unittest for JsonModelElement with different key orders.
* fixed unittests.
* fixed JsonModelElement.
* fixed unittest.
* fixed runAminerJsonInputDemo and added runJsonDemo script.
* added Json Tests to Jenkinsfile and testingwrapper.
* removed debug outputs.
* fixed Deepsource issues.
* fixed Deepsource issues.
* fixed json demo configs.
* fixed jenkinsfile
* fixed Jenkinsfile.
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
* HOTFIX 3 (#560)
* added DetectionTimestamp to json output.
* fixed unittests.
* fixed unittests.
* fixed KafkaEventHandlerTest.
* fixed testingwrapper.
* fixed runAminerElasticsearchDemo.sh
* undid changes in testingwrapper.
* resolved conflicts
* fixed kafka tests.
* fixed JsonModelElement error and specified output in the VerboseUnparsedAtomHandler.
* extended sleep time in Suspend mode test.
* fixed JsonModelElement when key is missing.
* fixed Deepsource issues.
* added special key ALLOW_ALL for JsonModelElement.
* fixed zero start handling of the JsonStateMachine.
* fixed errors in JSON input data handling and JsonStateMachine.
* fixed data.
* created first config for elastic.log and fixed more errors.
* finished json-elastic-demo.yml.
* added config for eve.json and fixed more JSON parsing errors.
* fixed more errors.
* added config for journal.log.
* added wazuh config.
* added logging to the JsonModelElement.
* added unittest for JsonModelElement with different key orders.
* fixed unittests.
* fixed JsonModelElement.
* fixed unittest.
* fixed runAminerJsonInputDemo and added runJsonDemo script.
* added Json Tests to Jenkinsfile and testingwrapper.
* removed debug outputs.
* fixed Deepsource issues.
* fixed Deepsource issues.
* fixed json demo configs.
* fixed jenkinsfile
* fixed Jenkinsfile.
* fixed Jenkinsfile.
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
* 048 missing match path det (#555)
* added DetectionTimestamp to json output.
* fixed unittests.
* fixed unittests.
* fixed KafkaEventHandlerTest.
* fixed testingwrapper.
* fixed runAminerElasticsearchDemo.sh
* undid changes in testingwrapper.
* resolved conflicts
* fixed kafka tests.
* changed MissingMAtchPathValueDetector to use a list of paths instead one single path.
* fixed Deepsource issues.
* added test with multiple lines.
* fixed configs.
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
* 043 rewrite date time me tests (#531)
* added DetectionTimestamp to json output.
* fixed unittests.
* fixed unittests.
* fixed KafkaEventHandlerTest.
* fixed testingwrapper.
* fixed runAminerElasticsearchDemo.sh
* undid changes in testingwrapper.
* resolved conflicts
* fixed kafka tests.
* changed test to check WHITESPACE usage.
* added new testcase design for FixedDME.
* rewrote some unittests for the FixedDME.
* finished rewriting unittests for the FixedDME.
* fixed Deepsource issues.
* added unittests for simple methods of FixedDME.
* designed test cases for the DTME.
* designed new test cases and extended existing ones from DateTimeModelElement.
* added a new test case.
* added unittests and changed initialization from None to 0 for DateTimeModelElement
* added more unittests to DateTimeME. Rewrote DummyMatchContext and adapted all rewritten unittests.
* added more unittests.
* added more unittests.
* added more unittests.
* added the last unittests.
* implemented missing tests and text_locale.
* fixed DateTimeModelElement.
* fixed Deepsource issues.
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
* 049 log prefix (#558)
* added DetectionTimestamp to json output.
* fixed unittests.
* fixed unittests.
* fixed KafkaEventHandlerTest.
* fixed testingwrapper.
* fixed runAminerElasticsearchDemo.sh
* undid changes in testingwrapper.
* resolved conflicts
* fixed kafka tests.
* added default value for log_line_prefix.
* fixed Deepsource issues.
* fixed deepsource issues.
* fixed Deepsource issues.
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
* 050 aminer demo fail on error (#562)
* added DetectionTimestamp to json output.
* fixed unittests.
* fixed unittests.
* fixed KafkaEventHandlerTest.
* fixed testingwrapper.
* fixed runAminerElasticsearchDemo.sh
* undid changes in testingwrapper.
* resolved conflicts
* fixed kafka tests.
* changed runAminerDemo to fail if an error occurred.
* fixed jsonConverterHandler demo config.
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
* 051 remove sudo installed (#563)
* added DetectionTimestamp to json output.
* fixed unittests.
* fixed unittests.
* fixed KafkaEventHandlerTest.
* fixed testingwrapper.
* fixed runAminerElasticsearchDemo.sh
* undid changes in testingwrapper.
* resolved conflicts
* fixed kafka tests.
* removed sudoInstalled from test scripts.
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
* 052 suppress unparsed detector (#564)
* added DetectionTimestamp to json output.
* fixed unittests.
* fixed unittests.
* fixed KafkaEventHandlerTest.
* fixed testingwrapper.
* fixed runAminerElasticsearchDemo.sh
* undid changes in testingwrapper.
* resolved conflicts
* fixed kafka tests.
* added suppress_unparsed config.
* added suppress_unparsed to BaseSchema.
* fixed error.
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
* 053 reimplement dtme (#571)
* added DetectionTimestamp to json output.
* fixed unittests.
* fixed unittests.
* fixed KafkaEventHandlerTest.
* fixed testingwrapper.
* fixed runAminerElasticsearchDemo.sh
* undid changes in testingwrapper.
* resolved conflicts
* fixed kafka tests.
* added handling of different timezones.
* removed unneeded variable.
* fixed deepsource issues.
* fixed error with changed format specifier length.
* removed comment.
* added missing cases.
* fixed MissingMatchPathValueDetector unittests.
* changed datetime imports.
* fixed Deepsource issues.
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
* 055 esd path list optional (#575)
* added DetectionTimestamp to json output.
* fixed unittests.
* fixed unittests.
* fixed KafkaEventHandlerTest.
* fixed testingwrapper.
* fixed runAminerElasticsearchDemo.sh
* undid changes in testingwrapper.
* resolved conflicts
* fixed kafka tests.
* made id_path_list in ESD optional.
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
* 054 rewrite multi locale dtme (#572)
* added DetectionTimestamp to json output.
* fixed unittests.
* fixed unittests.
* fixed KafkaEventHandlerTest.
* fixed testingwrapper.
* fixed runAminerElasticsearchDemo.sh
* undid changes in testingwrapper.
* resolved conflicts
* fixed kafka tests.
* added handling of different timezones.
* renamed function.
* removed unneeded variable.
* added some tests.
* fixed deepsource issues.
* added more unittests for MultiLocaleDTME.
* added more unittests for the MultiLocaleDTME.
* fixed error with changed format specifier length.
* removed comment.
* added more unittests.
* added more tests.
* added missing cases.
* fixed MissingMatchPathValueDetector unittests.
* added last unittests for MultiLocaleDTME.
* fixed Deespource issues.
* added MultiLocaleDTME to the DTME class.
Fixed some unittests.
* changed datetime imports.
* fixed some issues.
* changed tests.
* implemented MultiLocaleDateTimeModelElement.
* fixed YamlConfig for DateTimeModelElement and MultiLocaleDTME.
* removed old MultiLocaleDateTimeModelElement.
* fixed YamlConfig for MultiLocaleDateTimeModelElement.
* fixed error in VTD.
* fixed VTD.
* fixed VTD.
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
* renamed schemas to .json. (#589)
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
* added null value handling in JsonModelElement. (#591)
* added null value handling in JsonModelElement.
* fixed order of ifs.
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
* Add floor and ceil in EFD check (#585)
* Add floor and ceil in EFD check
* Fix rounding and tests.
* hotfix. (#593)
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
* Fix unparsed leap day in syslog parsing model (#582)
* Release 2.3.0 (#594)
* modified version of pyyaml in requirements.txt
* New version v2.3.0
Co-authored-by: Wolfgang Hotwagner <wolfgang.hotwagner@ait.ac.at>
* Update README.md
* Update README.md
* fix PYL-R1714
* removed orig-files from merge
* fixed deepsource issues. (#599)
* fixed deepsource issues.
* fixed deepsource issues.
* fixed deepsource issues for VCD.
* fixed deepsource issues.
* fixed deepsource issues.
* fixed deepsource issues.
* fixed deepsource issues.
* fixed deepsource issues.
* fixed deepsource issues.
* fixed deepsource issues.
* fixed deepsource issues.
* fixed deepsource issues.
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
Co-authored-by: hoeldg <georg.hoeld@ait.ac.at>
Co-authored-by: root <max.landauer@ait.ac.at>
Co-authored-by: 4cti0nfi9ure <16901151+4cti0nfi9ure@users.noreply.github.com>
Co-authored-by: Max Landauer <landauermax@users.noreply.github.com>
Co-authored-by: Wolfgang Hotwagner <wolfgang.hotwagner@ait.ac.at>
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
Co-authored-by: dITySoftware <56120276+dITySoftware@users.noreply.github.com>
Co-authored-by: hoeldg <66625424+hoeldg@users.noreply.github.com>
* aminer.py: resolved hardcoded username and gropname where user_id and… (#614)
* aminer.py: resolved hardcoded username and gropname where user_id and group_id was expected
* aminer.py: fixed bug in getgrnam(). username was taken instead of groupname
Co-authored-by: Wolfgang Hotwagner <wolfgang.hotwagner@ait.ac.at>
* Release 2.3.1
* removed merge-files
* removed merge-files
* fixed refactoring issues in AnalysisChild
* removed old json-files from json-directory
* fixed problems with merging
Co-authored-by: hoeldg <georg.hoeld@ait.ac.at>
Co-authored-by: root <max.landauer@ait.ac.at>
Co-authored-by: 4cti0nfi9ure <16901151+4cti0nfi9ure@users.noreply.github.com>
Co-authored-by: Max Landauer <landauermax@users.noreply.github.com>
Co-authored-by: Wolfgang Hotwagner <wolfgang.hotwagner@ait.ac.at>
Co-authored-by: Ernst Leierzopf <ernst.leierzopf.fl@ait.ac.at>
Co-authored-by: dITySoftware <56120276+dITySoftware@users.noreply.github.com>
Co-authored-by: hoeldg <66625424+hoeldg@users.noreply.github.com>
![[bug history graph]](https://qa.debian.org/data/bts/graphs/l/logdata-anomaly-miner.png){kind=link}