Digital Life / Broadband

Thomas-Salmen

Broadband Service Control in the Orcon Network - Followup

24 November 2008 - Written by Thomas Salmen - Broadban

Due to the number of comments and questions I've received about my previous post on the Service Control Engine and how we use it to manage international transit, I've put together a bit of a followup piece. There have also been a number of changes to the implementation recently that are worth sharing as well.

Since launching our UCLL network earlier in the year, we've seen pretty huge growth in the volume of traffic we're carrying.

I presented a paper recently where I shared a few statistics on the network and recent trends. For example:

  • Our UCLL subscribers achieve an average linespeed of just over 10Mb.
  • The lower quartile linespeed sits at around 5Mb - which is slightly higher than the average linespeed we used to see on the UBA/S network.
  • Our DSL customers alone consume over 15Tb of data per day.
  • Our DSL customers consumed over 10Tb of Olympics streaming coverage in ten days.
  • Customers on the Orcon+ network (UCLL) consume nearly twice as much data per month on average as our UBA/S (Telecom Wholesale) customers.
  • Streaming video now accounts for at least 30% of international traffic. Peer to peer uses approx another 30%, web 30%, and the remaining 10% by all other applications.

So bandwidth requirements in our network are growing at an exponential rate. It's driving a few architectural changes within our network, such as:

  • We're moving to 10Gb Ethernet for our metro backhaul network.
  • Many exchanges are being moved to Gigabit Ethernet.
  • We're moving our transit links to 10Gb Ethernet and upgrading our DPI platforms to cope with the volumes in traffic.

The last point is a particularly relevant one for the purposes of this article. As covered off in my earlier post on the subject, our approach until recently has been to group all subscribers into a single pool based on their connection type - e.g. UBS, UCLL, dialup, etc. The result has been chunks of bandwidth that look like this:

Old bandwidth allocation

This has changed recently in that each and every subscriber now has an individual policy of their own. This policy does two things:

  • It sets a peak rate. For ADSL2+ this is 24Mb.
  • It sets a priority for that subscriber.
  • It sets a priority for P2P vs everything else for that subscriber.

This has the effect of distributing bandwidth fairly across all subscribers. It means that heavy users won't unduly impact the experience for lighter users by consuming a proportionally larger amount of bandwidth. It's important to note though that users aren't classified as "heavy" or "light" - it simply means that a user downloading an email or web page from overseas (e.g. light and bursty usage) won't be negatively impacted by those who are streaming video or downloading a P2P file (e.g. sustained and high bandwidth usage).

In graphical form:

New bandwidth allocation using the SCE

On a related topic - one of the most commonly asked question so far has been whether there is any difference between ADSL and ADSL2+ connections in how they are treated on the SCE?

In short, no, but there are some differences in broadband products which are worth mentioning. There are two sub-policies to the broadband "pool" of bandwidth: one for UCLL, and the other for UBA. Our retail UCLL services are dimensioned roughly 3 times higher than UBA services, and that flows through to the SCE config. UCLL services are only ADSL2+; UBA are a mix of ADSL and ADSL2+. The UBS policies don't differentiate between ADSL and ADSL2+ subscribers - and in fact we have no way of knowing which type of line a subscriber is on without asking Telecom.

The dimensioning rules are a direct result of the backhaul capacity allocated within the respective networks: the Telecom UBA network (basic UBA) is dimensioned at 32kbps per subscriber averaged over 15 minutes. The Orcon+ network is dimensioned over three times that.

Feel free to post comments below (or over on my blog if you would prefer); if any further questions come up I'll do another followup piece.

Leave a comment

Please note that your comments are moderated, so it may take a little while for them to appear.

Comments

Hayden Tennent

25 November 2008 - 1:17 pm

So does this mean that I can give you some more $$$ and get a higher ‘priority’ on my subscriber policy?

Jayson

25 November 2008 - 1:28 pm

I have UCLL and find that the international speep tends to be slow quite often and only reaching speeds of between 126kbps and 300kbps, national is fine.
My modem sync’s at between 10000-13000kbps but when the international speed plays up the sync speed drops to around 4000kbps-6000kbps and takes days for it to go back to what it actually was.

Is this caused by the changes Orcon has been doing, I mean I’m only 1.5KM from my exchange.

Thomas Salmen - Orcon

26 November 2008 - 8:41 pm

@Hayden Tennent:

This is actually quite a good question, and the answer is a bit more complex than just a straight “yes” or “no”.

Strictly speaking, yes you can pay for a higher grade of bandwidth - if you’re buying a business product delivered over a frame relay or metro ethernet circuit. However I’m assuming that your questions relates just to your retail UCLL or UBA connection, in which case the answer is currently no.

The configuration we have deployed is designed for one thing only, and that’s fair and even allocation of bandwidth amongst all users buying a particular service. We don’t offer a higher grade of bandwidth or preferential treatment of traffic in exchange for a higher monthly fee. We may in the future customize the traffic management policies on a per user basis and give users some control over their own traffic within our network - but what this looks like, what it costs, and how it’s implemented, I don’t yet know.

@ Jayson

I would strongly suggest logging a fault the next time it occurs. If your sync speed is reducing significantly like that then there’s a good chance a line fault exists. A line fault can manifest in reduced international speeds without appearing to affect domestic speeds due to the higher latency to international sites.

Duncan

8 December 2008 - 9:12 pm

Thanks for your article.  One question - is your allocation of bandwidth per user dynamic or static.  In other words, if user X is not on line, is their bandwidth kept available for them 24/7, or is it redistributed to active users?

AJB

18 February 2009 - 11:22 am

OK, so does the SCE *really* filter packet by packet or is there some effect where, if P2P is detected to a subscriber’s IP (say the latest Ubuntu is out) then all traffic for the next xx minutes is deprioritized?  That’s what *seems* to happen on my connection…..Cheers