Guest Post: "The technical side of a radio station" by Arran Hodges

Liam Burke • Dec 04, 2020

This weeks guest post is by Arran Hodges from Reach Radio

This post was originally posted on Arran's blog https://thisisarran.me/index.php/2020/12/04/the-technical-side-of-a-radio-station/ and is reproduced here by his kind permission. If you have a post you'd like share, please contact us and let us know!

When we had an idea to start a radio station- we didn’t really know where to start. There is so much work that goes into it- a lot on both the technical side and on the actual station output side too! I’ve done quite a bit of the setting up of the technology so I’ll go through some of the things that I had to think about before deploying networks and technology to keep a radio station online 24/7.


We had so many meetings back and forth with the brilliant guys over at Broadcast Radio. They produce a piece of software called Myriad. This is by far the biggest technical challenge that I have had to think around- since it’s not designed for our specific use. The whole application runs off of either local files or SMB shares and a Microsoft SQL server. There are four different instances that we had to plan around. Two of these instances would be in the same building as the server- however the rest would have had to have gone through a VPN connection in order to achieve remote access.


So- firstly.. how do we connect the multiple sites together? As a small start up the budget for anything technical is extremely small. Upon joining a group which discusses all things to do with the software that we used there was a suggestion made for people who use the Remote Voice Tracking client to use ZeroTier VPN for security and other reasons. Upon inspection- this particular client combines the capabilities of a VPN and a software defined network. ZeroTier is also an open source application that provides peer-to-peer connections- meaning that the connection doesn’t need to pass through any kinds of servers and as a result the latency seems to be brilliant. We took the advice that was in the support group and adapted the model of the use to be for our larger network that ran playout installs and SMB shares + connect together our SQL server to the different networks to give up-to-date information regarding playout and also have the ability to have 2-way-syncing. This worked really well for us.


It’s crucial that we had playout installed physically rather than the cloud because of this exact reason- I don’t believe we could have achieved what we have done without having it physically stored. The drawback of having this physically installed is that it runs off of a home network that can get congested at times (meaning slower loading times) and doesn’t have a suitable SLA agreed with the provider- therefore susceptible to drop outs in the transmission chain. We’ll talk about the ways to prevent the station going off air at this point later on. It’s worth noting that we have imported as much as we can infrastructure wise to FyfeWeb– a brilliant service provider. You should check them out.


Let’s talk about the transmission chain altogether. There are lots of moving parts within this;


Everything runs from Icecast within this chain. Since a physical audio switcher isn’t possible- this is the next best thing. The switching is done via fallback mounts on the raw feed of audio that’s being sent. Remote Contribution could be any of 3 studios- when they are live, they get broadcasted out to the listener via the two Icecast relays. As you can see from the diagram above- this goes through about 3 servers and 7 mountpoints. What’s not being seen here, though, is the transcoding that’s happening behind the scenes to provide lower bitrate mountpoints in formats like AAC or MP3. The audio switching on the playout system side is handled by Myriad’s built in smart log transfer.


Speaking of Icecast- it’s vital that you provide all of your audio via SSL now. Chrome 80 that was released earlier on this year had a security upgrade that meant that HTTP media requests would automatically get upgraded to the secure form, HTTPS. If HTTPS is unavailable- the request will fail. This was an issue for many stations around the globe that didn’t really know about this feature update- listeners weren’t actually able to tune in online to a lot of commercial stations here in the UK- which wasn’t a desired outcome. You can view more about Mixed Messages on chrome here.


So- it was important that we had a version of Icecast that supported SSL. There were two main options- Icecast-KH or a modified version of Icecast that Xiph provides with support for SSL. Since I didn’t have much knowledge of streaming solutions back then I decided to opt for the pre-compiled Xiph version of Icecast. Adding SSL is actually more simple to do than I imagined with Icecast- I make use of the LetsEncrypt certbot which gives you a free SSL certificate. Since we have 2 relays to add SSL to that are in a DNS round robin- it’s always interesting to see which one resolves first. This also means that we have to keep a close eye on expiry dates- as we can’t automatically renew both at the same time. There is a configuration I have found for it but I’m not particularly interested at this point in pursuing it.


Going off air in the case of a network dropout was a significant concern for me personally as it’s placed in a home environment. I’m not worried about the physical equipment- just the network that it ran on so I made sure that there were contingencies in place in the case of a network dropout. On both relays- there is a separate “backup” stream that is with a completely different provider that will automatically be fallen back on if connectivity goes boom. This has saved us in so many ways imaginable- from routine system maintenance to full on disasters this has always been a part of our contingency plan that every single station should have. This backup stream runs from open source software, namely AzuraCast. Additionally- AzuraCast provides all of the transcoded streams for the relays to play at lower bitrates too. It’s a brilliant piece of kit for you to use. Check them out here.


Also- since there’s no silence detection along the chain of transmission we have placed a silence detector that listens to the feed of both streams (studio 1 and remote contribution) and run PiraCZ silence detection software in order to be notified when something may go down. This is placed on a server in a datacenter so emails can still be sent if the network connection has stopped working in the main location.


The whole prospect of both server and playout upgrades are daunting for anyone who works with servers. It’s extremely time consuming but a small task compared to some of the security flaws that have been discovered with certain versions of Windows. Firstly- we need to install the specific Windows & Myriad version we want to upgrade to on a machine that doesn’t power any on air output just in case the update messes up drivers for audio cards and things. Once it’s been verified that everything works- the playout is transferred to a remote location that caches the audio that’s in the playout system and the next 50 or so media items so that the station can carry on running from the outside broadcast mount. Then both the server and playout PCs are upgraded and maintenance is performed on them- and then everything should be able to be transferred back to our “automation” PC.


We haven’t even gone into the depths of audio routing and how presenters can go live using AOIP from across the UK.. but I think that’s enough of telling our secrets for one day!


Once everything is put together- you get a radio station that is online 24/7.


By Liam Burke 12 May, 2023
Myriad v6 Public Beta testing has been going well... REALLY well!
By Liam Burke 19 Apr, 2022
This smart microphone may be ideal for Myriad Anywhere users.
By Liam Burke 28 Jun, 2021
Image Source: Pexels
By Liam Burke 26 Feb, 2021
We are often asked for recommendations for smaller, low cost mixers for stations that are launching on a tight budget or looking to add additional studio capacity as cost effectively as possible. Type 'stereo mixer' into Google and literally hundreds of options will come up but the vast majority of them are not really suitable for use with Myriad because they do not have enough stereo inputs, are designed for sound mixing or do not offer the basic facilities needed to present a radio show. But there are a few that could be considered as a possible alternative to a full broadcast mixer. The Behringer DX2000USB may be the ideal mixer for smaller stations, as long as they are willing to live the compromises it brings when used in a broadcast radio environment.
Home Studio Mixer Review For Myriad Anywhere
By Liam Burke 28 Jul, 2020
With the World still struggling to adapt to the 'new normal' of working from home and minimising social contact, more and more stations are using Myriad Anywhere to enable presenters to record Remote Voice Tracks or even prevent live shows from their own home studios. Generally, all you need is a good microphone and a pair of headphones (we recommend a headset if possible) but we are hearing from a number of customers who are looking to create a home studio setup to allow them to get more creative and emulate their studio experience. So we thought we would take a quick look at a couple of home mixer options that work well with both Myriad Anywhere and fully installed Myriad Playout.
By Liam Burke 29 Jun, 2020
Sometimes you want to repeat complete Log hours in your schedule. Under normal circumstances, Myriad Schedule (or AutoTrack) will generate a new Log Hour for every hour of the week. But once you have edited and Voice Tracked an hour, it is sometimes good to be able to re-use that Log Hour elsewhere in your schedule or maybe even on another Station (if you are running more than one. This can be done using the Log.CopyHour Command.
Myriad RVT & Anywhere Cloud
By Liam Burke 22 Apr, 2020
We ran the numbers and stations are using Myriad Remote Voice Tracking, a lot! Let's take a closer look.
By Liam Burke 02 Apr, 2020
There is one question we have been asked again and again in the past few weeks, how can we present a live show from a home? With many stations now finding access to their studio restricted and increasing restrictions on non-essential travel, most stations are now having to consider how they can continue to provide vital services. We are doing everything we can to assist stations through these difficult times with regular software updates that include features to assist with remote working as well as help articles and documents to help people get the most from their systems. To recap, the remote working options for Myriad 5 Playout users are: Remote Voice Tracking (RVT) - Desktop application that allows you to edit the Log and add Voice Tracks. Myriad Anywhere RVT (Cloud or Self Hosted) - Similar feature set to RVT but with a web based interface to allow greater access across a wider range of devices. Myriad Playout Remote - Desktop application that offers partial remote control over your studio Myriad 5 Playout system. 3rd Party Remote Control Solutions (Teamviewer, VNC etc) - Services that offer full remote control of your Myriad 5 Playout System to allow advanced features such as scheduling, but not usually useful for audio based features such as RVT. Myriad Anywhere is explained in detail on the Myriad Anywhere section of our website and full documentation on both Myriad Anywhere and RVT can be found in the documentation section of our support site. Voice Tracking provides a great way to add 'live' sounding elements to your automated output and for many stations, will be the main tool used to 'keep the lights on'. But what about if you want to present a live show from a remote location? What tools will you need and how will you go about setting it up?
By Liam Burke 18 Mar, 2020
Myriad Playout v4 and v5 have both always had very strong remote features and this document will outline those features, potential use cases, and security precautions. The features and security precautions can be different between the 2 product versions, so any differences will be noted in each section. Products covered: Myriad Playout Remote v5 Myriad Anywhere (Cloud) v5 Myriad Anywhere (Self Hosted) v5 Myriad Remote Voice Tracking v5 and v4 Myriad Monitor v4 Other 3rd party Remote Control Products
By Liam Burke 17 Mar, 2020
At Broadcast Radio, we work very hard to make sure that our products and services stay running whenever the office is closed, and a couple of years ago we started a rolling project to make sure that we could carry on even if we couldn't make it into the office. TL;DR: We are ready for Covid-19 and for our people to work from home. To save you reading the rest of this article (unless you want to!), every single person who works for Broadcast Radio has been trained on how to access all the normal office documents, the phone systems, email, Instant Messaging, Technical Support Resources and CRM systems so that they can carry on as normal, if and when they need to work remotely. Wherever needed we've provided PC's, laptops, screens, comms headsets and other devices to any of our people that need them, and in the event that the office has to be physically closed, we will just carry on with a "virtual" office with business as usual on all the usual phone numbers and email addresses. Our main priority has been to make sure our people are safe and well first, and only after that, to make sure we can provide the tools they need to help our customers do the same. As the vast majority of our customers are radio stations, it's essential they can stay operating for as long possible, and part of that is making sure we are there to back them up, so making sure our people can answer the phones and email as normally as possible remains our goal for as long as this outbreak lasts. A bit more background The Broadcast Radio office is based on an office park that sits on the banks of the Humber Estuary - which is one of the largest waterways in the UK - and on a good day gives an amazing view out of the office window - the picture above of the Humber Bridge was taken just now from the offfice car park to prove the point! With the great scenery comes a risk though - water not staying where it should. The office itself sits very high up so is in no risk of flooding, but 5 years ago the river overflowed after very several days of very heavy rain, and one of the roads nearby was impassible for a day, meaning that about 20% of our people couldn't easily make it to the office. Because we had already planned for this eventuality, the actual impact was minimal - our people just switched to working remotely, and business carried on as usual. Although it has a tongue-in-cheek in name, we started our planning under the name "Project Zombocalypse" many years ago when we wanted to make sure that as many aspects of running the company could be carried out remotely should the need ever arise. This light-hearted look at scenarios starts with the premise that we can't leave our homes due to that most infamous of all movie genres, the Zombie outbreak, so we need to carry on on the assumption that getting to the office is out of the question. We started by breaking down the task into 2 parts - People and Infrastructure - and like everything we do here, people are first. A) People first! To start with, we needed to work out who could do their work from home - and with the exception of our actual studio build engineers, the vast majority of our team could indeed work remotely. Sales, Admin, Technical Support and the R&D teams can all carry out 95% of their jobs without needing to be in the building for quite a long period. Ok, great, but HOW will they actually do that? This really is where you have to think quite carefully, so we broke that down into sub-sections, and then worked out answers for each one: PC's: An obvious one really, people need to be able to access the resources in the office remotely in the same way that they use them when they are in the building - users don't like "friction", so wherever possible, resources, documents, software etc. should all be accessible in familiar ways. The answer is actually remarkably simple for normal office use - "Remote Desktop" is built into Windows and is ideal for the job. To access their desktop PC's we made sure that each user knows how to VPN in to the office network from their home PC's, and what their desktop PC is called, that way they can just pick up where they left off. Interestingly, several users don't have a home PC at all, having switched to tablets and phones for home web browsing etc, so we made sure we have a stock of company laptops ready to go and these are issued out to anyone who needs them. Phones: Most of our people talk to customers every single day on the phone, so we needed to make sure you can still dial the office numbers and get through to the right people. Over the years we've worked our way through various different solutions to this, but a couple of years ago we switched to using a 3CX phone system and everyone now has the 3CX app on their mobile phones that can be set to mirror their desktop phone with 2 taps. So if they do need to work remotely, they just open the app, "activate" the account and straight away calls will flow to them over their broadband connection. This means it's totally free for them to use - no fear of accidentally running up big personal phone bills when calling customers as the call is routed to the office and then onward from there to our normal phone lines. In fact, we love 3CX so much that we are now a certified and accredited re-seller of 3CX products to the industry. Inter-person/office communication: Phones are great, but actually a huge amount of our inter-person communication is text based - either emails or Instant Messaging ("IM") - so we needed to make sure that we keep that all running as well. In fact, when users are physically separated it becomes essential to keep good communication flowing . For both email and IM we turned to Microsoft - for years we had been running Microsoft Exchange and Skype for Business on servers at the office, but 4 years ago we switched to Office 365 and then IM to Microsoft Teams, so both of those are now hosted and run for us by Microsoft for little to no cost. MS Outlook and MS Teams are available as desktop applications, mobile apps (for both iOS and Android) and also via web browsers, so again, we made sure that everyone knows how to access email and IM from their mobiles as well as using the regular tools they are used to on their office PC's. Internet Connectivity: all of the above only works if we can guarantee internet access to the office so users can VPN in (for PC's) and access the phone system. To make sure we stay connected, we have 3 dedicated fibre circuits into the building, each of which can handle all of the data needed to keep us running. We also have a fallback wireless circuit from a different telco which can be enabled should the need ever arise. Once you've identified the areas above, next you have to make sure that people can actually use those - do people have a good enough broadband connection at home? Do they have a PC? Do they have a suitable workspace that they will be comfortable to work in for the duration of a working day - for example, one of our people has a home pc, but it's plugged into their TV for use as a gaming system and home theatre system. If they ever have to work from home for an extended period, their kids will likely want to use that TV for Netflix, so we made sure that we sent home a dedicated monitor for them to use on their home-office desk instead. Small things, but easy to miss when you are "blue sky thinking" about how to handle these scenarios. B) Infrastructure This itself breaks down into quite a few different areas, so i'll only touch lightly on each: Office files and servers : The core of any business, your data is your second most important asset, so you should protect them wherever possible. We run a minimum of 2 live copies of all data here in the office, as well as 2 separate backup solutions, and 2 different off site backup technologies. That's everything from spreadsheets and word documents, to product test data and source code. In fact our source code actually lives in 2 separate places on TOP of those above, that's how critical it is! Customer support servers: We have a number of servers that exist to make sure that our customers keep going - for example Product License Activation servers and Technical Support. These run on 2 separate systems so should one fail the other can take over. We can also manually generate licenses and handle support via email alone should the need arise. Hosting services: We also provide streaming for hundreds of different radio stations all over the world, as well an increasing number of "Radio In the Cloud" customers where we host the infrastructure for stations for them. These streaming and hosting servers are located in commercial data centres around the UK so enjoy all the benefits of huge backup generators and redundant architecture. A number of the Radio in the Cloud services are also hosted at the Broadcast Radio Offices, so these also get additional facilities to make sure they stay up and running. Interestingly, when you come to look at supporting remote working, it's actually only item 1 above (office files) that you have make sure are available for that part of the business, and as we've already made sure people can remote in and access their content, this is already covered! In the last few years we've also started a big change to moving more and more of our office files into cloud provided services like Microsoft Sharepoint and Dropbox as this reduces the requirement for office infrastructure even more. We're also hosting more and more of our proprietary data in private Microsoft Azure spaces as well. So in summary, we have now activated our plans ready for whatever comes next: Everyone here has checked and confirmed they can make and receive calls via the normal numbers from wherever they need to. Everyone here has checked and confirmed they can access their office PCs remotely. This includes making sure the PC is left switched on, or remotely "wakeable", should the need arise Everyone knows how to access email and instant messaging via web browsers etc. Everyone has the right equipment already at their homes to allow remote working. We have checked that all our physical IT infrastructure is working and that backup services are ready. We have turned off the coffee machine. For now, thats all that's needed. Of course, the situation is rapidly evolving, and over the coming days there will be all manner of surprises and twists to come, and of course we will face our own challenges as it's likely that some of our people will need to rest and recuperate, but we are happy that we have planned for the most likely outcomes, and have the flexibility to adapt should we need to.
Show More
Share by: