<?xml-stylesheet type="text/xsl" href="https://community.element14.com/cfs-file/__key/system/syndication/rss.xsl" media="screen"?><rss version="2.0" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:slash="http://purl.org/rss/1.0/modules/slash/" xmlns:wfw="http://wellformedweb.org/CommentAPI/"><channel><title>Linux commands can turn a log into structured data (turn a TTN Gatesway log into a csv)</title><link>/technologies/internet-of-things/b/blog/posts/linux-commands-can-turn-a-log-into-structured-data-turn-a-ttn-gatesway-log-into-a-csv</link><description>A bit of Linux play. How to turn an active unstructured log file into structured data.image source: nightcafe 
Like many programs, my The Things Network Gateway generates a verbose log file. A lot of information. Every so many (&amp;gt; 1000) lines, there..</description><dc:language>en-US</dc:language><generator>Telligent Community 12</generator><item><title>RE: Linux commands can turn a log into structured data (turn a TTN Gatesway log into a csv)</title><link>https://community.element14.com/technologies/internet-of-things/b/blog/posts/linux-commands-can-turn-a-log-into-structured-data-turn-a-ttn-gatesway-log-into-a-csv</link><pubDate>Mon, 22 Jan 2024 20:05:54 GMT</pubDate><guid isPermaLink="false">93d5dcb4-84c2-446f-b2cb-99731719e767:aee27aa4-386d-4203-848e-769603979ba3</guid><dc:creator>shabaz</dc:creator><slash:comments>0</slash:comments><description>&lt;p&gt;Great AI pic! That is actually a close visual representation to how&amp;nbsp;my brain&amp;nbsp;feels when working with Regexp&amp;#39;s/sed/awk.&amp;nbsp;&lt;/p&gt;&lt;img src="https://community.element14.com/aggbug?PostID=27470&amp;AppID=27&amp;AppType=Weblog&amp;ContentType=0" width="1" height="1"&gt;</description></item><item><title>RE: Linux commands can turn a log into structured data (turn a TTN Gatesway log into a csv)</title><link>https://community.element14.com/technologies/internet-of-things/b/blog/posts/linux-commands-can-turn-a-log-into-structured-data-turn-a-ttn-gatesway-log-into-a-csv</link><pubDate>Sun, 21 Jan 2024 20:45:41 GMT</pubDate><guid isPermaLink="false">93d5dcb4-84c2-446f-b2cb-99731719e767:aee27aa4-386d-4203-848e-769603979ba3</guid><dc:creator>Jan Cumps</dc:creator><slash:comments>0</slash:comments><description>&lt;p&gt;A bit of analysis. 83 contacts in 5 hours&lt;/p&gt;
&lt;p&gt;&lt;img alt=" " height="260" src="/resized-image/__size/338x520/__key/commentfiles/f7d226abd59f475c9d224a79e3f0ec07-aee27aa4-386d-4203-848e-769603979ba3/pastedimage1705869464411v1.png" width="169" /&gt;&lt;/p&gt;
&lt;p&gt;sorted by amount of messages sent:&lt;/p&gt;
&lt;p&gt;&lt;img alt=" " height="98" src="/resized-image/__size/294x196/__key/commentfiles/f7d226abd59f475c9d224a79e3f0ec07-aee27aa4-386d-4203-848e-769603979ba3/pastedimage1705869653744v2.png" width="147" /&gt;&lt;/p&gt;
&lt;p&gt;Except for my own Arduino, I do not know what these devices are. 030D318 is definitely a TTN device. It appears in the online console log. Some of them aren&amp;#39;t. Those appear in my gateway log but not in&amp;nbsp; TTN&amp;#39;s console.&amp;nbsp;&lt;/p&gt;
&lt;p&gt;The DevAddr aren&amp;#39;t the device IDs on TTN. This ID gets assigned when joining, and I can only check the ones for my own devices.&lt;/p&gt;&lt;img src="https://community.element14.com/aggbug?PostID=27470&amp;AppID=27&amp;AppType=Weblog&amp;ContentType=0" width="1" height="1"&gt;</description></item><item><title>RE: Linux commands can turn a log into structured data (turn a TTN Gatesway log into a csv)</title><link>https://community.element14.com/technologies/internet-of-things/b/blog/posts/linux-commands-can-turn-a-log-into-structured-data-turn-a-ttn-gatesway-log-into-a-csv</link><pubDate>Sun, 21 Jan 2024 20:30:06 GMT</pubDate><guid isPermaLink="false">93d5dcb4-84c2-446f-b2cb-99731719e767:aee27aa4-386d-4203-848e-769603979ba3</guid><dc:creator>DAB</dc:creator><slash:comments>0</slash:comments><description>&lt;p&gt;Nice post Jan.&lt;/p&gt;&lt;img src="https://community.element14.com/aggbug?PostID=27470&amp;AppID=27&amp;AppType=Weblog&amp;ContentType=0" width="1" height="1"&gt;</description></item><item><title>RE: Linux commands can turn a log into structured data (turn a TTN Gatesway log into a csv)</title><link>https://community.element14.com/technologies/internet-of-things/b/blog/posts/linux-commands-can-turn-a-log-into-structured-data-turn-a-ttn-gatesway-log-into-a-csv</link><pubDate>Sun, 21 Jan 2024 01:45:50 GMT</pubDate><guid isPermaLink="false">93d5dcb4-84c2-446f-b2cb-99731719e767:aee27aa4-386d-4203-848e-769603979ba3</guid><dc:creator>balajivan1995</dc:creator><slash:comments>1</slash:comments><description>&lt;p&gt;Hi,&lt;/p&gt;
&lt;p&gt;Have you tried pasting the script in GitHub gist and embedding here?&lt;/p&gt;&lt;img src="https://community.element14.com/aggbug?PostID=27470&amp;AppID=27&amp;AppType=Weblog&amp;ContentType=0" width="1" height="1"&gt;</description></item></channel></rss>