Any BI or log tools to import dumb file [closed]












0















Currently we do not have any log tools for filtering a huge dumb file. Is there any open source BI or log tool able to import a dumb file and do auto/selectable filtering?



Current dumb file example:



2019-02-11 03:06:30.202  INFO maskParams=false

2019-02-11 03:06:30.205  INFO Start request :: ipAddress=103.22.200.95

2019-02-11 03:06:30.205  INFO  User-Agent = Mozilla/5.0 (Linux; U; Android 7.1.1; zh-cn; MI MAX 2 Build/NMF26F) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/61.0.3163.128 Mobile 

Safari/537.36 XiaoMi/MiuiBrowser/10.5.1

2019-02-11 03:06:30.205  INFO  Request Query String=[customer_name]

2019-02-11 03:06:30.335  INFO  Checking current ip address

2019-02-11 03:06:30.335  ERROR Not a valid ip address 2408:84e4:412:4b02:73cd:9684:1ab0:8437

2019-02-11 03:06:30.336  INFO  Get country from GeoIpRange, ip =2408:84e4:412:4b02:73cd:9684:1ab0:8437

2019-02-11 03:06:30.336  ERROR Not a valid ip address 2408:84e4:412:4b02:73cd:9684:1ab0:8437

2019-02-11 03:06:30.385  INFO  End request (00:00:00.183)


After importing the dumb file, able to provide me the below details:




  • Start Date and time/

  • End Date and time/

  • customer name/

  • no valid ip address details






text-processing logs







share|improve this question















closed as too broad by Jeff Schaller, Christopher, Sparhawk, jimmij, Mr Shunz Feb 15 at 10:32


Please edit the question to limit it to a specific problem with enough detail to identify an adequate answer. Avoid asking multiple distinct questions at once. See the How to Ask page for help clarifying this question. If this question can be reworded to fit the rules in the help center, please edit the question.























    0















    Currently we do not have any log tools for filtering a huge dumb file. Is there any open source BI or log tool able to import a dumb file and do auto/selectable filtering?



    Current dumb file example:



    2019-02-11 03:06:30.202  INFO maskParams=false
    
2019-02-11 03:06:30.205  INFO Start request :: ipAddress=103.22.200.95
    
2019-02-11 03:06:30.205  INFO  User-Agent = Mozilla/5.0 (Linux; U; Android 7.1.1; zh-cn; MI MAX 2 Build/NMF26F) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/61.0.3163.128 Mobile 
    
Safari/537.36 XiaoMi/MiuiBrowser/10.5.1
    
2019-02-11 03:06:30.205  INFO  Request Query String=[customer_name]
    
2019-02-11 03:06:30.335  INFO  Checking current ip address
    
2019-02-11 03:06:30.335  ERROR Not a valid ip address 2408:84e4:412:4b02:73cd:9684:1ab0:8437
    
2019-02-11 03:06:30.336  INFO  Get country from GeoIpRange, ip =2408:84e4:412:4b02:73cd:9684:1ab0:8437
    
2019-02-11 03:06:30.336  ERROR Not a valid ip address 2408:84e4:412:4b02:73cd:9684:1ab0:8437
    
2019-02-11 03:06:30.385  INFO  End request (00:00:00.183)


    After importing the dumb file, able to provide me the below details:




    • Start Date and time/

    • End Date and time/

    • customer name/

    • no valid ip address details






    text-processing logs







    share|improve this question















    closed as too broad by Jeff Schaller, Christopher, Sparhawk, jimmij, Mr Shunz Feb 15 at 10:32


    Please edit the question to limit it to a specific problem with enough detail to identify an adequate answer. Avoid asking multiple distinct questions at once. See the How to Ask page for help clarifying this question. If this question can be reworded to fit the rules in the help center, please edit the question.





















      0












      0








      0








      Currently we do not have any log tools for filtering a huge dumb file. Is there any open source BI or log tool able to import a dumb file and do auto/selectable filtering?



      Current dumb file example:



      2019-02-11 03:06:30.202  INFO maskParams=false
      
2019-02-11 03:06:30.205  INFO Start request :: ipAddress=103.22.200.95
      
2019-02-11 03:06:30.205  INFO  User-Agent = Mozilla/5.0 (Linux; U; Android 7.1.1; zh-cn; MI MAX 2 Build/NMF26F) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/61.0.3163.128 Mobile 
      
Safari/537.36 XiaoMi/MiuiBrowser/10.5.1
      
2019-02-11 03:06:30.205  INFO  Request Query String=[customer_name]
      
2019-02-11 03:06:30.335  INFO  Checking current ip address
      
2019-02-11 03:06:30.335  ERROR Not a valid ip address 2408:84e4:412:4b02:73cd:9684:1ab0:8437
      
2019-02-11 03:06:30.336  INFO  Get country from GeoIpRange, ip =2408:84e4:412:4b02:73cd:9684:1ab0:8437
      
2019-02-11 03:06:30.336  ERROR Not a valid ip address 2408:84e4:412:4b02:73cd:9684:1ab0:8437
      
2019-02-11 03:06:30.385  INFO  End request (00:00:00.183)


      After importing the dumb file, able to provide me the below details:




      • Start Date and time/

      • End Date and time/

      • customer name/

      • no valid ip address details






      text-processing logs







      share|improve this question
















      Currently we do not have any log tools for filtering a huge dumb file. Is there any open source BI or log tool able to import a dumb file and do auto/selectable filtering?



      Current dumb file example:



      2019-02-11 03:06:30.202  INFO maskParams=false
      
2019-02-11 03:06:30.205  INFO Start request :: ipAddress=103.22.200.95
      
2019-02-11 03:06:30.205  INFO  User-Agent = Mozilla/5.0 (Linux; U; Android 7.1.1; zh-cn; MI MAX 2 Build/NMF26F) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/61.0.3163.128 Mobile 
      
Safari/537.36 XiaoMi/MiuiBrowser/10.5.1
      
2019-02-11 03:06:30.205  INFO  Request Query String=[customer_name]
      
2019-02-11 03:06:30.335  INFO  Checking current ip address
      
2019-02-11 03:06:30.335  ERROR Not a valid ip address 2408:84e4:412:4b02:73cd:9684:1ab0:8437
      
2019-02-11 03:06:30.336  INFO  Get country from GeoIpRange, ip =2408:84e4:412:4b02:73cd:9684:1ab0:8437
      
2019-02-11 03:06:30.336  ERROR Not a valid ip address 2408:84e4:412:4b02:73cd:9684:1ab0:8437
      
2019-02-11 03:06:30.385  INFO  End request (00:00:00.183)


      After importing the dumb file, able to provide me the below details:




      • Start Date and time/

      • End Date and time/

      • customer name/

      • no valid ip address details






      text-processing logs




      text-processing logs






      share|improve this question















      share|improve this question













      share|improve this question




      share|improve this question








      edited Feb 14 at 13:46









      fra-san

      1,8151518




      1,8151518










      asked Feb 14 at 12:57









      julian leejulian lee

      51




      51




      closed as too broad by Jeff Schaller, Christopher, Sparhawk, jimmij, Mr Shunz Feb 15 at 10:32


      Please edit the question to limit it to a specific problem with enough detail to identify an adequate answer. Avoid asking multiple distinct questions at once. See the How to Ask page for help clarifying this question. If this question can be reworded to fit the rules in the help center, please edit the question.









      closed as too broad by Jeff Schaller, Christopher, Sparhawk, jimmij, Mr Shunz Feb 15 at 10:32


      Please edit the question to limit it to a specific problem with enough detail to identify an adequate answer. Avoid asking multiple distinct questions at once. See the How to Ask page for help clarifying this question. If this question can be reworded to fit the rules in the help center, please edit the question.
























          1 Answer
          1






          active

          oldest

          votes


















          0














          There are many open source log collectors and indexers:



          Splunk? Elasticsearch? Logstash? Kibana?



          Are they BI tools? I'm not sure. Only if you plot some business metrics I guess.






          share|improve this answer
























          • i had tested Splunk and it really give me what I wanted. Thanks!

            – julian lee
            Feb 15 at 3:02


















          1 Answer
          1






          active

          oldest

          votes








          1 Answer
          1






          active

          oldest

          votes









          active

          oldest

          votes






          active

          oldest

          votes









          0














          There are many open source log collectors and indexers:



          Splunk? Elasticsearch? Logstash? Kibana?



          Are they BI tools? I'm not sure. Only if you plot some business metrics I guess.






          share|improve this answer
























          • i had tested Splunk and it really give me what I wanted. Thanks!

            – julian lee
            Feb 15 at 3:02
















          0














          There are many open source log collectors and indexers:



          Splunk? Elasticsearch? Logstash? Kibana?



          Are they BI tools? I'm not sure. Only if you plot some business metrics I guess.






          share|improve this answer
























          • i had tested Splunk and it really give me what I wanted. Thanks!

            – julian lee
            Feb 15 at 3:02














          0












          0








          0







          There are many open source log collectors and indexers:



          Splunk? Elasticsearch? Logstash? Kibana?



          Are they BI tools? I'm not sure. Only if you plot some business metrics I guess.






          share|improve this answer













          There are many open source log collectors and indexers:



          Splunk? Elasticsearch? Logstash? Kibana?



          Are they BI tools? I'm not sure. Only if you plot some business metrics I guess.







          share|improve this answer












          share|improve this answer



          share|improve this answer










          answered Feb 14 at 15:35









          MarcelMarcel

          1865




          1865













          • i had tested Splunk and it really give me what I wanted. Thanks!

            – julian lee
            Feb 15 at 3:02



















          • i had tested Splunk and it really give me what I wanted. Thanks!

            – julian lee
            Feb 15 at 3:02

















          i had tested Splunk and it really give me what I wanted. Thanks!

          – julian lee
          Feb 15 at 3:02





          i had tested Splunk and it really give me what I wanted. Thanks!

          – julian lee
          Feb 15 at 3:02



          -

          Popular posts from this blog

          How to make a Squid Proxy server?

          Image
          1 I want to set up squid proxy server for monitoring user activity in a network and Internet Web URL filtering for user. I also want to configure the user login, user log, user access group, and block unwanted web sites in my network. Please help me and guide me the full process to do this. server proxy squid share | improve this question edited Jul 31 '12 at 14:45 Jorge Castro 37.1k 107 422 617 asked Jul 31 '12 at 5:16 Goivind Tiwari Goivind Tiwari ...
          Read more

          Is this a new Fibonacci Identity?

          Image
          6 1 $begingroup$ I have found the following Fibonacci Identity (and proved it). If $F_n$ denotes the nth Fibonacci Number, we have the following identity begin{equation} F_{n-r+h}F_{n+k+g+1} - F_{n-r+g}F_{n+k+h+1} = (-1)^{n+r+h+1} F_{g-h}F_{k+r+1} end{equation} where $F_1 = F_2 = 1$ , $r leq n$ , $h leq g$ , and $n, g, k in mathbb{N}$ . It is not too hard to show that this identity subsumes Cassini's Identity, Catalan's Identity, Vajda's Idenity, and d'Ocagne's identity to name a few. I have done a pretty thorough literature review, and I have not found anything like this, but I am still wondering if anyone has seen this identity before? I found this by accident after noticing some patterns in some analysis work I was doing, so if this is already known I would be curious to see w...
          Read more

          19世紀

          Image
          この記事は検証可能な参考文献や出典が全く示されていないか、不十分です。 出典を追加して記事の信頼性向上にご協力ください。 （ 2012年3月 ） 千年紀: 2千年紀 世紀: 18世紀 - 19世紀 - 20世紀 十年紀: 1800年代 1810年代 1820年代 1830年代 1840年代 1850年代 1860年代 1870年代 1880年代 1890年代 19世紀に君臨した大英帝国。 19世紀 （じゅうきゅうせいき）は、西暦1801年から西暦1900年までの100年間を指す世紀。 目次 1 19世紀の歴史 1.1 国民国家の成立 1.2 帝国主義の興隆 1.3 列強の植民地争奪戦 2 できごと 2.1 1800年代 2.2 1810年代 2.3 1820年代 2.4 1830年代 2.5 1840年代 2.6 1850年代 2.7 1860年代 2.8 1870年代 2.9 1880年代 2.10 1890年代 2.11 1900年代 3 文化 3.1 文学 3.2 音楽 3.3 思想 3.4 科学 3.5 技術 4 人物 4.1 ヨーロッパ 4.1.1 政治家・王族 4.1.1.1 フランス 4.1.1.2 オーストリア＝ハンガリー 4.1.1.3 ロシア 4.1.1.4 イギリス 4.1.1.5 ドイツ（プロイセンほかドイツ領邦を含む） 4.1.1.6 北欧 4.1.1.7 イタリア 4.1.1.8 スペイン 4.1.1.9 ベルギー 4.1.1.10 ギリシア 4.1.2 軍人 4.1.3 実業家 4.1.4 科学と技術 4.1.5 思想と哲学・人文諸学 4.1.6 宗教 4.1.7 文学 4.1.8 美術 4.1.9 音楽 4.1.10 社会事業家 4.1.11 探検家・旅行家 4.1.12 料...
          Read more