Falco: a quick and flexible single-cell RNA-seq processing framework on the cloud

Play Video

$2,000

Prizes

1,409

Views

1. Background

Rapid advancement in single-cell capture technology has resulted in increasing interest in single-cell level of study, particularly in the field of transcriptomics. This is because single-cell RNA-Seq (scRNA-seq) provides us with a better understanding of the underlying transcriptional heterogeniety of individual cells, therefore allowing us to better characterise cell subpopulations.

A scRNA-seq experiment typically generates profiles for hundred to thousands of cell. However, current tools are unable to efficiently handle the large amount of data. In order to fully realise the potential of single-cell RNA-Seq, we need a scalable and efficient computational solution.

2. Method

Falco is a cloud-based framework for parallelised processing of large-scale transcriptomic data geared for multi-sample analysis. Falco utilises Big Data analysis framework of Hadoop MapReduce and Apache Spark, which are industry standard framework which has been used in other fields to process terabytes and petabytes of data. Falco is currently designed for feature quantification of RNA-seq data using standard transcriptomics analysis tool such as STAR and HISAT2 for alignment, and HTSeq and featureCount for quantification.

The basis of Falco framework is the divide and conquer approach. We first divide the reads into multiple smaller files or 'chunks' in order to increase the level of paralellism in analysis and to normalise the performance of the tools. These chunks can then be optionally pre-processed using any pre-processing tools chosen by user to perform task such as removal of low quality reads and adapter trimming. Finally, each of the read chunks is aligned and quantified using the tools selected by the user, and the resulting gene counts per chunks are then merged to obtain the total read counts per sample.

3. Results

Falco was evaluated by comparing the performance of a popular RNA-seq pipeline (STAR and featureCount) on two single-cell RNA-seq datasets (a mouse embryonic stem cell data with 869 samples totalling to 1.02 Tb of fastq.gz files and a human brain data with 466 samples totalling to 213.6 Gb of fastq.gz files) with and without the Falco framework. Falco was able to speed up the analysis of the mouse dataset from 18.5 hours without Falco (1 node, 16 processes) down to just 2.8 hours (Falco, 40 nodes cluster). Similarly, we see a speed up of the human brain dataset analysis from 13.6 hours without Falco (1 node, 16 processes) down to 1.1 hours (Falco, 40 nodes cluster).

Falco also allows for cost-effective analysis through the use of Amazon Web Services (AWS) spot instances - unused computing capacity which are offered at a reduced cost compared to the normal 'on-demand' price. The use of spot instances for analysis provides a savings of ~65% compared to using 'on-demand' instances.

4. Conclusions

Falco is a quick and flexible cloud-based feature quantification framework which are able to analyse large volume of transcriptomic data. Falco simplifies the process of feature quantification analysis and is customisable, allowing user to use the analysis tools of their choice. Falco also allows for low-cost analysis through the use of AWS spot instances.

Falco is available to download from https://github.com/VCCRI/Falco.

5. Future ideas/collaborators needed to further research?

We plan to add support for running on traditional infrastructure and on existing Hadoop cluster. Furthermore, we are in the process of implementing other type of transcriptomic analysis, such as alignment only analysis, clustering of RNA-seq samples and transcript reconstruction.

6. Please share a link to your paper

Comments

2
Nicola Smith
about 1 year ago

Very interesting work!

hzxhzx hzxhzx
5 days ago

adidas outlet


adidas originals


nike shox


nike air max


vans outlet


givenchy handbags


ray ban sunglasses


balenciaga sandals


christian louboutin


nike kyrie 3


kate spade outlet


roshe run


stephen curry shoes


nike air max 90


ralph lauren uk


oakley sunglasses


true religion


hermes bags


nike lunarglide


timberland outlet


mishka clothing


undefeated clothing


polo outlet


louboutin


converse outlet


asics


louis vuitton outlet


coach outlet


oakley sunglasses


ferragamo


nike tn


michael kors outlet


louis vuitton outlet


nike trainers


vibram fivefingers


mont blanc pens


adidas jeremy scott


pandora jewelry


adidas outlet


flops


nike free


swarovski jewelry


manchester united jersey


coach outlet store online


jordan shoes


birkenstock outlet


nike huarache


nhl jerseys


ferragamo


michael kors outlet


coach outlet


coach outlet


mlb jerseys


manolo blahnik


lebron 15


nike roshe


supra shoes


cheap jerseys


bvlgari jewelry


adidas outlet


coach outlet


cheap jerseys


dior handbags


nike outlet store online


adidas yeezy


jordan shoes


red bottom shoes


coach wallets


adidas ultra boost


kevin durant shoes


ray ban sunglasses


polo ralph lauren


michaelkors outlet


ralph lauren


jordan 5


beats by dre


michael kors


barcelona jersey


mbt


timberland boots


coach handbags


red bottom shoes


louis vuitton


jordan 8


ralph lauren


michael kors handbags


louis vuitton outlet


mulberry


michael kors outlet


nike air max


stussy clothing


marc jacobs


longchamp


baseball jerseys


ray ban sunglasses


nike outlet


beats by dre


adidas yeezy


toms outlet


hermes


asics


dolce and gabbana


coach outlet online


wholesale snapback hats


ray ban sunglasses


birkenstock outlet online


gucci outlet


adidas nmd


jordan 1


new balance


ray bans


jordan 6


nike free


oakley sunglasses


mcm backpack


air jordan


replica rolex watches


nike dunks


flip-flops


cheap jordans


louis vuitton handbags


kate spade outlet


birkenstock sandals


louis vuitton outlet


michael kors


hollister outlet


adidas wings


balenciaga


jordan


ralph lauren


adidas


adidas nmd


yeezy shoes


jordans


herve leger dresses


ray ban sunglasses


new balance sandals


pandora jewelry


louboutin


louis vuitton


supreme new york


fingerlings monkey


mont blanc


puma fenty sandals


nike shoes


louis vuitton


polo ralph


ralph lauren


nike air max 1


cheap rolex watches


chicago blackhawks jersey


coach factory outlet


off-white


red bottom shoes


polo shirts


burberry outlet


coach outlet online


hermes belt


jordans


ray ban


flops


salvatore ferragamo


cartier bracelet


michael kors outlet


nfl jerseys


oakley sunglasses


longchamp outlet


oakley sunglasses


coach outlet


vans shoes


nike presto


nfl jerseys


harden vol 2


light up shoes


oakley sunglasses


true religion outlet


longchamp


burberry sale


jordan 3


rolex watches


coach outlet


louis vuitton handbags


air jordan


mbt


harden vol 1


kate spade handbags


toms shoes


nike blazer shoes


polo ralph


nike air force 1


oakley


ralph lauren outlet


timberland


nike mercurial


michael kors


kate spade


breitling watches


fitflops


nike huarache


michael kors outlet


nike free


tory burch outlet


dansko


gucci slides


kate spade outlet


nike sb


ralph lauren


nike huarache


jordans


nike air max 95


nike shoes


nfl jerseys


ray ban sunglasses


shoe carnival


jordan xx9


louis vuitton


nike shoes


michael kors handbags


louis vuitton outlet


mac cosmetics


hermes kelly bag


jordan shoes


jordan 12


supreme


prada outlet


off-white clothing


pandora jewelry


superdry clothing


michael kors outlet


oakley sunglasses


tag heuer watches


giuseppe zanotti


van cleef & arpels jewelry


jordan shoes


mont blanc pens


nike air max 97


louis vuitton handbags


nike blazer


kobe 11


replica watches


baseball bats


kate spade outlet


michael kors outlet


nike tennis


pandora outlet


nike air max


cheap nhl jerseys


longchamp outlet


michael kors


coach outlet


louis vuitton


michael kors


converse shoes


nba jerseys


supreme


running shoes


michael kors


coach outlet


true religion


coach outlet


birkenstock sandals


fitflops


louis vuitton


coach outlet


nike air max 2018


fila shoes


puma slides


under armour outlet


birkenstock outlet


suicoke sandals


ray ban


soccer jerseys


ralph lauren


burberry scarves


cheap oakley sunglasses


prada


malone souliers


cheap jerseys


jordan


tory burch outlet


bottega


nike outlet store


jimmy choo outlet


jordan 11


adidas flip flops


air jordan pas cher


timberland


polo ralph lauren


burberry outlet


louis vuitton


sac longchamp


coach factory outlet


nike factory outlet


nike flip-flops


valentino


prada


stuart weitzman


longchamp


michael kors outlet


wedding shoes


louis vuitton


hermes outlet


pandora charms


true religion outlet


nike shoes for women


oakley sunglasses


supreme clothing


breguet watches


louis vuitton outlet


air max


adidas stan smith


nike epic react flyknit


juicy couture outlet


true religion jeans


ralph lauren outlet


bcbg


nike air max plus


tory burch outlet


adidas football boots


ray ban sunglasses


belstaff outlet


tory burch


michael kors outlet


jordan shoes


balenciaga triple s


michael kors


pandora charms


mlb jerseys


yeezy 500


coach factory outlet


nike cortez


coach outlet


converse


nike store


y-3 shoes


basketball shoes


ray ban sunglasses


flip flops


adidas superstar


louis vuitton


polo outlet


cheap ray ban sunglasses


pandora jewelry


timberland


burberry outlet


fitflops


nike air max 270


nike outlet


nike air force 1


ray ban sunglasses


nike air


nike revolution


celine


coach outlet


mlb jerseys


tod's shoes


coach outlet


cheap nfl jerseys


jordans


oakley sunglasses


alexander mcqueen


adidas outlet store


audemars piguet


mizuno


fitflops


adidas slides


air jordan


pandora jewelry


coach bags


nike free run


miu miu handbags


polo ralph lauren


true religion jeans


nike air max 2017


swarovski


michael kors handbags


nike air max


pandora charms


air max


jordan 4


rolex watches


louboutin


ray ban


ralph lauren


prada outlet


jordan


rolex watches


links of london


swarovski


new balance shoes


adidas shoes


nike air max


louboutin shoes


christian louboutin


louboutin


christian louboutin


christian louboutin outlet


coach outlet


coach outlet online


michael kors outlet store


kobe 12 shoes


nfl jerseys wholesale


timberland boots

hzx20180516

Image1493012066?1493012066

Andrian Yang is a PhD candidate in the Bioinformatics and Systems Biology Laboratory at the Victor Chang Cardiac Research Institute. His PhD research focus is on utlising cloud computing to create ...

Recent Voters