Dithen: A Computation-as-a-Service Cloud Platform For Large-Scale Multimedia Processing

Article


Doyle, J., Giotsas, Vasileios, Ashraful Anam, Mohammed and Andreopoulos, Yiannis 2016. Dithen: A Computation-as-a-Service Cloud Platform For Large-Scale Multimedia Processing. IEEE Transactions on Cloud Computing. PP (99), pp. 1-1. https://doi.org/10.1109/TCC.2016.2617363
AuthorsDoyle, J., Giotsas, Vasileios, Ashraful Anam, Mohammed and Andreopoulos, Yiannis
Abstract

We present Dithen, a novel computation-as-a-service (CaaS) cloud platform specifically tailored to the parallel ex-ecution of large-scale multimedia tasks. Dithen handles the upload/download of both multimedia data and executable items, the assignment of compute units to multimedia workloads, and the reactive control of the available compute units to minimize the cloud infrastructure cost under deadline-abiding execution. Dithen combines three key properties: (i) the reactive assignment of individual multimedia tasks to available computing units according to availability and predetermined time-to-completion constraints; (ii) optimal resource estimation based on Kalman-filter estimates; (iii) the use of additive increase multiplicative decrease (AIMD) algorithms (famous for being the resource management in the transport control protocol) for the control of the number of units servicing workloads. The deployment of Dithen over Amazon EC2 spot instances is shown to be capable of processing more than 80,000 video transcoding, face detection and image processing tasks (equivalent to the processing of more than 116 GB of compressed data) for less than $1 in billing cost from EC2. Moreover, the proposed AIMD-based control mechanism, in conjunction with the Kalman estimates, is shown to provide for more than 27% reduction in EC2 spot instance cost against methods based on reactive resource estimation. Finally, Dithen is shown to offer a 38% to 500% reduction of the billing cost against the current state-of-the-art in CaaS platforms on Amazon EC2 (Amazon Lambda and Amazon Autoscale). A baseline version of Dithen is currently available at dithen.com.

JournalIEEE Transactions on Cloud Computing
Journal citationPP (99), pp. 1-1
ISSN2168-7161
Year2016
PublisherIEEE
Accepted author manuscript
Digital Object Identifier (DOI)https://doi.org/10.1109/TCC.2016.2617363
Web address (URL)http://ieeexplore.ieee.org/abstract/document/7590075/
Publication dates
Print13 Oct 2016
Publication process dates
Deposited30 Sep 2016
Accepted27 Sep 2016
FunderInnovate UK
Copyright information© 2016 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other users, including reprinting/ republishing this material for advertising or promotional purposes, creating new collective works for resale or redistribution to servers or lists, or reuse of any copyrighted components of this work in other works.
LicenseAll rights reserved
Permalink -

https://repository.uel.ac.uk/item/84z0y

Download files


Accepted author manuscript
  • 229
    total views
  • 311
    total downloads
  • 0
    views this month
  • 5
    downloads this month

Export as

Related outputs

gUML: Reasoning about Energy at Design Time by Extending UML Deployment Diagrams with Data Centre Contextual Information
Jebraeil, Nigar, Noureddine, A., Doyle, J., Islam, S. and Bashroush, R. 2017. gUML: Reasoning about Energy at Design Time by Extending UML Deployment Diagrams with Data Centre Contextual Information. in: 2017 IEEE World Congress on Services (SERVICES) IEEE. pp. In Press
Cloud Strife: Expanding the Horizons of Cloud Gaming Services
Doyle, J., Islam, S., Bashroush, R. and O'Mahony, Donal 2017. Cloud Strife: Expanding the Horizons of Cloud Gaming Services. in: 2017 IEEE World Congress on Services (SERVICES) IEEE.