Any BI or log tools to import dumb file [closed]
Currently we do not have any log tools for filtering a huge dumb file. Is there any open source BI or log tool able to import a dumb file and do auto/selectable filtering?
Current dumb file example:
2019-02-11 03:06:30.202 INFO maskParams=false
2019-02-11 03:06:30.205 INFO Start request :: ipAddress=103.22.200.95
2019-02-11 03:06:30.205 INFO User-Agent = Mozilla/5.0 (Linux; U; Android 7.1.1; zh-cn; MI MAX 2 Build/NMF26F) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/61.0.3163.128 Mobile
Safari/537.36 XiaoMi/MiuiBrowser/10.5.1
2019-02-11 03:06:30.205 INFO Request Query String=[customer_name]
2019-02-11 03:06:30.335 INFO Checking current ip address
2019-02-11 03:06:30.335 ERROR Not a valid ip address 2408:84e4:412:4b02:73cd:9684:1ab0:8437
2019-02-11 03:06:30.336 INFO Get country from GeoIpRange, ip =2408:84e4:412:4b02:73cd:9684:1ab0:8437
2019-02-11 03:06:30.336 ERROR Not a valid ip address 2408:84e4:412:4b02:73cd:9684:1ab0:8437
2019-02-11 03:06:30.385 INFO End request (00:00:00.183)
After importing the dumb file, able to provide me the below details:
- Start Date and time/
- End Date and time/
- customer name/
- no valid ip address details
text-processing logs
edited Feb 14 at 13:46
fra-san
1,8151518
asked Feb 14 at 12:57
julian leejulian lee
51
closed as too broad by Jeff Schaller, Christopher, Sparhawk, jimmij, Mr Shunz Feb 15 at 10:32
Please edit the question to limit it to a specific problem with enough detail to identify an adequate answer. Avoid asking multiple distinct questions at once. See the How to Ask page for help clarifying this question. If this question can be reworded to fit the rules in the help center, please edit the question.
add a comment |
Currently we do not have any log tools for filtering a huge dumb file. Is there any open source BI or log tool able to import a dumb file and do auto/selectable filtering?
Current dumb file example:
2019-02-11 03:06:30.202 INFO maskParams=false
2019-02-11 03:06:30.205 INFO Start request :: ipAddress=103.22.200.95
2019-02-11 03:06:30.205 INFO User-Agent = Mozilla/5.0 (Linux; U; Android 7.1.1; zh-cn; MI MAX 2 Build/NMF26F) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/61.0.3163.128 Mobile
Safari/537.36 XiaoMi/MiuiBrowser/10.5.1
2019-02-11 03:06:30.205 INFO Request Query String=[customer_name]
2019-02-11 03:06:30.335 INFO Checking current ip address
2019-02-11 03:06:30.335 ERROR Not a valid ip address 2408:84e4:412:4b02:73cd:9684:1ab0:8437
2019-02-11 03:06:30.336 INFO Get country from GeoIpRange, ip =2408:84e4:412:4b02:73cd:9684:1ab0:8437
2019-02-11 03:06:30.336 ERROR Not a valid ip address 2408:84e4:412:4b02:73cd:9684:1ab0:8437
2019-02-11 03:06:30.385 INFO End request (00:00:00.183)
After importing the dumb file, able to provide me the below details:
- Start Date and time/
- End Date and time/
- customer name/
- no valid ip address details
text-processing logs
edited Feb 14 at 13:46
fra-san
1,8151518
asked Feb 14 at 12:57
julian leejulian lee
51
closed as too broad by Jeff Schaller, Christopher, Sparhawk, jimmij, Mr Shunz Feb 15 at 10:32
Please edit the question to limit it to a specific problem with enough detail to identify an adequate answer. Avoid asking multiple distinct questions at once. See the How to Ask page for help clarifying this question. If this question can be reworded to fit the rules in the help center, please edit the question.
add a comment |
Currently we do not have any log tools for filtering a huge dumb file. Is there any open source BI or log tool able to import a dumb file and do auto/selectable filtering?
Current dumb file example:
2019-02-11 03:06:30.202 INFO maskParams=false
2019-02-11 03:06:30.205 INFO Start request :: ipAddress=103.22.200.95
2019-02-11 03:06:30.205 INFO User-Agent = Mozilla/5.0 (Linux; U; Android 7.1.1; zh-cn; MI MAX 2 Build/NMF26F) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/61.0.3163.128 Mobile
Safari/537.36 XiaoMi/MiuiBrowser/10.5.1
2019-02-11 03:06:30.205 INFO Request Query String=[customer_name]
2019-02-11 03:06:30.335 INFO Checking current ip address
2019-02-11 03:06:30.335 ERROR Not a valid ip address 2408:84e4:412:4b02:73cd:9684:1ab0:8437
2019-02-11 03:06:30.336 INFO Get country from GeoIpRange, ip =2408:84e4:412:4b02:73cd:9684:1ab0:8437
2019-02-11 03:06:30.336 ERROR Not a valid ip address 2408:84e4:412:4b02:73cd:9684:1ab0:8437
2019-02-11 03:06:30.385 INFO End request (00:00:00.183)
After importing the dumb file, able to provide me the below details:
- Start Date and time/
- End Date and time/
- customer name/
- no valid ip address details
text-processing logs
edited Feb 14 at 13:46
fra-san
1,8151518
asked Feb 14 at 12:57
julian leejulian lee
51
Currently we do not have any log tools for filtering a huge dumb file. Is there any open source BI or log tool able to import a dumb file and do auto/selectable filtering?
Current dumb file example:
2019-02-11 03:06:30.202 INFO maskParams=false
2019-02-11 03:06:30.205 INFO Start request :: ipAddress=103.22.200.95
2019-02-11 03:06:30.205 INFO User-Agent = Mozilla/5.0 (Linux; U; Android 7.1.1; zh-cn; MI MAX 2 Build/NMF26F) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/61.0.3163.128 Mobile
Safari/537.36 XiaoMi/MiuiBrowser/10.5.1
2019-02-11 03:06:30.205 INFO Request Query String=[customer_name]
2019-02-11 03:06:30.335 INFO Checking current ip address
2019-02-11 03:06:30.335 ERROR Not a valid ip address 2408:84e4:412:4b02:73cd:9684:1ab0:8437
2019-02-11 03:06:30.336 INFO Get country from GeoIpRange, ip =2408:84e4:412:4b02:73cd:9684:1ab0:8437
2019-02-11 03:06:30.336 ERROR Not a valid ip address 2408:84e4:412:4b02:73cd:9684:1ab0:8437
2019-02-11 03:06:30.385 INFO End request (00:00:00.183)
After importing the dumb file, able to provide me the below details:
- Start Date and time/
- End Date and time/
- customer name/
- no valid ip address details
text-processing logs
text-processing logs
edited Feb 14 at 13:46
fra-san
1,8151518
asked Feb 14 at 12:57
julian leejulian lee
51
edited Feb 14 at 13:46
fra-san
1,8151518
asked Feb 14 at 12:57
julian leejulian lee
51
edited Feb 14 at 13:46
fra-san
1,8151518
edited Feb 14 at 13:46
fra-san
1,8151518
edited Feb 14 at 13:46
fra-san
1,8151518
1,8151518
asked Feb 14 at 12:57
julian leejulian lee
51
asked Feb 14 at 12:57
julian leejulian lee
51
asked Feb 14 at 12:57
julian leejulian lee
51
51
closed as too broad by Jeff Schaller, Christopher, Sparhawk, jimmij, Mr Shunz Feb 15 at 10:32
Please edit the question to limit it to a specific problem with enough detail to identify an adequate answer. Avoid asking multiple distinct questions at once. See the How to Ask page for help clarifying this question. If this question can be reworded to fit the rules in the help center, please edit the question.
closed as too broad by Jeff Schaller, Christopher, Sparhawk, jimmij, Mr Shunz Feb 15 at 10:32
Please edit the question to limit it to a specific problem with enough detail to identify an adequate answer. Avoid asking multiple distinct questions at once. See the How to Ask page for help clarifying this question. If this question can be reworded to fit the rules in the help center, please edit the question.
add a comment |
add a comment |
1 Answer
1
active
oldest
votes
There are many open source log collectors and indexers:
Splunk? Elasticsearch? Logstash? Kibana?
Are they BI tools? I'm not sure. Only if you plot some business metrics I guess.
answered Feb 14 at 15:35
MarcelMarcel
1865
i had tested Splunk and it really give me what I wanted. Thanks!
– julian lee
Feb 15 at 3:02
add a comment |
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
There are many open source log collectors and indexers:
Splunk? Elasticsearch? Logstash? Kibana?
Are they BI tools? I'm not sure. Only if you plot some business metrics I guess.
answered Feb 14 at 15:35
MarcelMarcel
1865
i had tested Splunk and it really give me what I wanted. Thanks!
– julian lee
Feb 15 at 3:02
add a comment |
There are many open source log collectors and indexers:
Splunk? Elasticsearch? Logstash? Kibana?
Are they BI tools? I'm not sure. Only if you plot some business metrics I guess.
answered Feb 14 at 15:35
MarcelMarcel
1865
i had tested Splunk and it really give me what I wanted. Thanks!
– julian lee
Feb 15 at 3:02
add a comment |
There are many open source log collectors and indexers:
Splunk? Elasticsearch? Logstash? Kibana?
Are they BI tools? I'm not sure. Only if you plot some business metrics I guess.
answered Feb 14 at 15:35
MarcelMarcel
1865
There are many open source log collectors and indexers:
Splunk? Elasticsearch? Logstash? Kibana?
Are they BI tools? I'm not sure. Only if you plot some business metrics I guess.
answered Feb 14 at 15:35
MarcelMarcel
1865
answered Feb 14 at 15:35
MarcelMarcel
1865
answered Feb 14 at 15:35
MarcelMarcel
1865
answered Feb 14 at 15:35
MarcelMarcel
1865
1865
i had tested Splunk and it really give me what I wanted. Thanks!
– julian lee
Feb 15 at 3:02
add a comment |
i had tested Splunk and it really give me what I wanted. Thanks!
– julian lee
Feb 15 at 3:02
i had tested Splunk and it really give me what I wanted. Thanks!
– julian lee
Feb 15 at 3:02
i had tested Splunk and it really give me what I wanted. Thanks!
– julian lee
Feb 15 at 3:02
add a comment |
