https://fraserc182.github.io/ I had to migrate our self-hosted grafana instance from the default sqllite DB to RDS postgres. I ran into a few issues while doing so, so have documented them here. ## steps The steps to migrate were: Create RDS db Prepare DB Connect grafana to new DB It seems simple but... Wed, 17 Jan 2024 00:00:00 +0000 https://fraserc182.github.io/2024-01-17-grafana-migration/ https://fraserc182.github.io/2024-01-17-grafana-migration/ I had to configure a new service which listened on a UDP port and would accept data. This was setup but my question was how to actually test the connectivity of the port and ensure data was acceepted. To do this I wrote a python script: import socket server_address =... Tue, 24 Oct 2023 00:00:00 +0100 https://fraserc182.github.io/2023-10-24-testing-udp-connectivity/ https://fraserc182.github.io/2023-10-24-testing-udp-connectivity/ Recently I was trying to update a Postgres RDS instance from 10.21 to 14.8 The update failed with the following error: Your installation contains tables declared WITH OIDS, which is not supported anymore. Consider removing the oid column using ALTER TABLE ... SET WITHOUT OIDS; A list of tables with... Fri, 06 Oct 2023 00:00:00 +0100 https://fraserc182.github.io/2023-10-06-rds-oids/ https://fraserc182.github.io/2023-10-06-rds-oids/ There is no waiter configuration for kinesis data analytics applications. Recently I had to write the config for one myself. The below can be used in a file and imported to a script as a module. KDA waiter Click to expand from botocore.waiter import WaiterModel, create_waiter_with_client class KdaWaiter(): """ Class... Fri, 26 Aug 2022 00:00:00 +0100 https://fraserc182.github.io/2022-08-26-boto3-kda-waiter/ https://fraserc182.github.io/2022-08-26-boto3-kda-waiter/ Recently I was asked to write a script to monitor & alert on failed DAG runs on Apache Airflow. This script was to run on AWS lambda. Airflow To really really over simplify Airflow, it is just a UI for cron. It runs python scripts which are called DAG’s on... Wed, 01 Dec 2021 00:00:00 +0000 https://fraserc182.github.io/2021-12-01-airflow-monitoring/ https://fraserc182.github.io/2021-12-01-airflow-monitoring/ I’ve found the official docs to be lacking when installing netbox on CentOS.When moving Netbox to a new server I scripted the entire install, this should be easy enough to modify if required or just copy the steps and do it manually. When using the script, the only extra part... Wed, 24 Mar 2021 12:45:00 +0000 https://fraserc182.github.io/2021-03-24-installing-netbox-on-centos-7-8/ https://fraserc182.github.io/2021-03-24-installing-netbox-on-centos-7-8/ This is a script I use in a variety of ways. It’s good to have it available when you need to run commands against a lot of devices.It’s a simple concept, write what you want in the csv file and then the script loops through it executing those commands on... Sun, 21 Feb 2021 15:53:00 +0000 https://fraserc182.github.io/2021-02-21-using-input-from-csv-to-run-commands-against-network-devices/ https://fraserc182.github.io/2021-02-21-using-input-from-csv-to-run-commands-against-network-devices/ There was one issue with my previous </a>about using python to find interfaces on a certain vlan and this was the length of time it took to actually complete the script.From start to finish the script took 3 minutes and 20 seconds, which is still significantly better than doing it... Mon, 13 Jan 2020 15:32:00 +0000 https://fraserc182.github.io/2020-01-13-connecting-to-network-devices-concurrently-using-python/ https://fraserc182.github.io/2020-01-13-connecting-to-network-devices-concurrently-using-python/ This topic was the first thing I ever wanted to get out of automation and is what kick-started my learning.And again, this is all available on my github.I had a simple use case which went like so: Iterate through a list of switchesRun the show interface status commandCheck if a... Wed, 18 Dec 2019 22:57:00 +0000 https://fraserc182.github.io/2019-12-18-using-python-to-find-interfaces-on-a-specific-vlan/ https://fraserc182.github.io/2019-12-18-using-python-to-find-interfaces-on-a-specific-vlan/ In our environment we use Windows Network Policy Server (NPS) for our Radius solution. When we were having some issues with authentication to certain switches I realised that the logs were not being monitored by Splunk as I previously thought. After some digging, I found NPS can write logs to... Wed, 18 Dec 2019 21:51:00 +0000 https://fraserc182.github.io/2019-12-18-monitoring-windows-nps-logs-with-splunk/ https://fraserc182.github.io/2019-12-18-monitoring-windows-nps-logs-with-splunk/ Parsedmarc is an open source linux tool that can read DMARC reports, parse the results into an RFC compliant format and then output it as JSON.It is an excellent tool and also integrates with Splunk very nicely which is why I thought to write about it here.The parsedmarc documentation can... Wed, 20 Nov 2019 23:42:00 +0000 https://fraserc182.github.io/2019-11-20-parsedmarc/ https://fraserc182.github.io/2019-11-20-parsedmarc/