R parallelism and multithreading (Page 2) - Matlab, R project and Python | futures.io
futures.io futures trading

Go Back   futures.io

> Futures Trading, News, Charts and Platforms > Platforms and Indicators > Matlab, R project and Python

R parallelism and multithreading
Started:November 5th, 2013 (07:12 PM) by Big Mike Views / Replies:1,231 / 11
Last Reply:February 7th, 2016 (12:44 AM) Attachments:0

Welcome to futures.io.

Welcome, Guest!

This forum was established to help traders (especially futures traders) by openly sharing indicators, strategies, methods, trading journals and discussing the psychology of trading.

We are fundamentally different than most other trading forums:
  • We work extremely hard to keep things positive on our forums.
  • We do not tolerate rude behavior, trolling, or vendor advertising in posts.
  • We firmly believe in openness and encourage sharing. The holy grail is within you, it is not something tangible you can download.
  • We expect our members to participate and become a part of the community. Help yourself by helping others.

You'll need to register in order to view the content of the threads and start contributing to our community. It's free and simple, and we will never resell your private information.

-- Big Mike

Thread Tools Search this Thread

R parallelism and multithreading

Old January 25th, 2016, 03:47 AM   #11 (permalink)
Elite Member
Manchester, NH
Futures Experience: Beginner
Platform: thinkorswim
Broker/Data: TD Ameritrade
Favorite Futures: Stocks
Posts: 838 since Jul 2012
Thanks: 579 given, 1,649 received

The reason R is slow is because the garbage collector in R is backed by circular doubly linked lists that are slow to traverse and likely wipe out your CPU cache each GC cycle. In turn, this GC is triggered very frequently because of excessive use of redundant, temporary objects under the hood that immediately get swept for GC. Some of my colleagues use R extensively so we have a custom R kernel that mitigates this issue, and we found that the performance gain of rewriting the generational GC in R exceeds that of naive parallelism with mapreduce constructs in most cases.

At a time when I used to know very little about R, I felt that it had lacked language constructs suitable for parallelism. Having spent more time reading others' (more experienced than myself) R code, I've realized that it's actually inherently parallel if you are comfortable with a functional paradigm.

I would encourage people to use whatever language they're most comfortable learning, and worry about performance optimization later.

Reply With Quote
The following 2 users say Thank You to artemiso for this post:

Old February 7th, 2016, 12:44 AM   #12 (permalink)
Elite Member
Futures Experience: Advanced
Platform: NinjaTrader , Multicharts and my own system
Favorite Futures: Futures
Posts: 242 since Feb 2015
Thanks: 17 given, 353 received


Multi-threaded R

Last edited by Aufidius; February 7th, 2016 at 02:34 AM.
Reply With Quote


futures.io > Futures Trading, News, Charts and Platforms > Platforms and Indicators > Matlab, R project and Python > R parallelism and multithreading

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Upcoming Webinars and Events (4:30PM ET unless noted)

NinjaTrader 8: Programming Profitable Trading Edges w/Scott Hodson

Elite only

Anthony Drager: Executing on Intermarket Correlations & Order Flow, Part 2

Elite only

Adam Grimes: Five critically important keys to professional trading

Elite only

Machine Learning Concepts w/FIO member NJAMC

Elite only

MarketDelta Cloud Platform: Announcing new mobile features

Dec 1

NinjaTrader 8: Features and Enhancements

Dec 6

All times are GMT -4. The time now is 11:14 AM.

Copyright © 2016 by futures.io. All information is for educational use only and is not investment advice.
There is a substantial risk of loss in trading commodity futures, stocks, options and foreign exchange products. Past performance is not indicative of future results.
no new posts

Page generated 2016-10-27 in 0.06 seconds with 18 queries on phoenix via your IP