NexusFi: Find Your Edge


Home Menu

 





NexusFi site changelog and issues/problem reporting


Discussion in Feedback and Announcements

Updated
      Top Posters
    1. looks_one Big Mike with 2,132 posts (3,879 thanks)
    2. looks_two bobwest with 254 posts (490 thanks)
    3. looks_3 xplorer with 225 posts (382 thanks)
    4. looks_4 SMCJB with 99 posts (109 thanks)
      Best Posters
    1. looks_one bobwest with 1.9 thanks per post
    2. looks_two Big Mike with 1.8 thanks per post
    3. looks_3 xplorer with 1.7 thanks per post
    4. looks_4 SMCJB with 1.1 thanks per post
    1. trending_up 1,159,999 views
    2. thumb_up 6,294 thanks given
    3. group 164 followers
    1. forum 3,855 posts
    2. attach_file 551 attachments




 
Search this Thread

NexusFi site changelog and issues/problem reporting

  #2791 (permalink)
NinjaCat68
Blanes+ Girona/Spain
 
Posts: 2 since Jun 2020
Thanks Given: 8
Thanks Received: 0

Hello i'm new user from Barcelona..i trade futures on NT8..some good idea,indicators,strategy qnd VPS..i need some help..Thanks EveryBody.
Big Mike View Post
The above was due to hardware changes for the site. I migrated to:

- 10th gen CPU, i9-10900X
- 128GB memory
- 8TB NVMe drive

As I mentioned many pages back as something I wanted to do... I left Google Cloud Compute and reverted back to something far simpler. Instead of a triple node MariaDB Galera replication system, with multiple physical nodes for the application servers, I reverted back to something that served us well for years. A single node setup.

Just like trading, you have to always be learning. The reason I went with GCP in the first place was because of rolling hardware upgrades and reliability, both having been the weak point of our old setup (aging hardware).

However, that aging hardware was mostly because we owned it and we co-lo'd into a datacenter. If I didn't own the hardware, I would have been more willing to ditch it earlier and upgrade in between Intel release cycles.

But GCP added complexity that proved to not solve problems for us, but create them, and it was also noticeably slower due to optimization for mutli-core deployments but at slower clock rates.

So I searched and found a high-clock rate replacement better suited for our workload. Less cores, but higher clock. I went with an i9-10900X for its stability, in a server class motherboard. Sure, we give up ECC ram but my experience tells me it's not important in real-world, where higher clock certainly is.

I also upgraded to an 8TB NVMe, specifically the HGST SN200. It can do 1.2M IOPS and 6GB/sec transfer, a significant improvement over anything we've had before.

When you look at our biggest threads, like the SP500 Spoonalysis thread, it was taking 2.5-3.0 seconds to load per page on the GCP hardware. Now we are down to less than 1 second, a massive improvement.

You should also see similar performance gains when creating a new post, as that was one of the slower aspects of the old system as well. The current bottleneck in that regard is related to the number of Followers in the thread, as notifications are processed in real-time when you submit the post (architecture of vb 3.8).

Since we gave up triple node redundancy with Galera, I am instead doing real-time hot backups of the databases using mydumper, combined with real-time file system sync using lsyncd. We have a much smaller backup node on a private VLAN at the same datacenter, to hold our backups and with the ability to step in at any time to replace the master in an emergency.

Anyway, having moved to Dockerized containers a while back, there is no real issue migrating from one host to another any longer. But please do report any problems, nonetheless.

Mike

Sent using the NexusFi mobile app

Reply With Quote

Can you help answer these questions
from other members on NexusFi?
My NT8 Volume Profile Split by Asian/Euro/Open
NinjaTrader
Build trailing stop for micro index(s)
Psychology and Money Management
Better Renko Gaps
The Elite Circle
ZombieSqueeze
Platforms and Indicators
New Micros: Ultra 10-Year & Ultra T-Bond -- Live Now
Treasury Notes and Bonds
 
  #2792 (permalink)
 
Big Mike's Avatar
 Big Mike 
Manta, Ecuador
Site Administrator
Developer
Swing Trader
 
Experience: Advanced
Platform: Custom solution
Broker: IBKR
Trading: Stocks & Futures
Frequency: Every few days
Duration: Weeks
Posts: 50,399 since Jun 2009
Thanks Given: 33,175
Thanks Received: 101,541


xplorer View Post
Yep, there seems to be a problem with some of the downloads




Alright, I've duplicated the problem. Let me see what is causing it...

Mike

We're here to help: just ask the community or contact our Help Desk

Quick Links: Change your Username or Register as a Vendor
Searching for trading reviews? Review this list
Lifetime Elite Membership: Sign-up for only $149 USD
Exclusive money saving offers from our Site Sponsors: Browse Offers
Report problems with the site: Using the NexusFi changelog thread
Follow me on Twitter Visit my NexusFi Trade Journal Started this thread Reply With Quote
Thanked by:
  #2793 (permalink)
 
Big Mike's Avatar
 Big Mike 
Manta, Ecuador
Site Administrator
Developer
Swing Trader
 
Experience: Advanced
Platform: Custom solution
Broker: IBKR
Trading: Stocks & Futures
Frequency: Every few days
Duration: Weeks
Posts: 50,399 since Jun 2009
Thanks Given: 33,175
Thanks Received: 101,541



Big Mike View Post
Alright, I've duplicated the problem. Let me see what is causing it...

Mike

Alright, should be solved @xplorer and @evevee please confirm.

Was an issue with 512-byte sector vs 4k sector alignment with XFS, when we migrated servers last time apparently we switched from a 512-byte sector to a 4k sector and nginx AIO/directio flag wasn't aligned properly.

I've been sick all week so haven't been on the site which is why it took so long to resolve. Plus this only affected files larger than 32M which is a minority.

Mike

We're here to help: just ask the community or contact our Help Desk

Quick Links: Change your Username or Register as a Vendor
Searching for trading reviews? Review this list
Lifetime Elite Membership: Sign-up for only $149 USD
Exclusive money saving offers from our Site Sponsors: Browse Offers
Report problems with the site: Using the NexusFi changelog thread
Follow me on Twitter Visit my NexusFi Trade Journal Started this thread Reply With Quote
Thanked by:
  #2794 (permalink)
 
xplorer's Avatar
 xplorer 
London UK
Site Moderator
 
Experience: Beginner
Platform: CQG
Broker: S5
Trading: Futures
Posts: 5,945 since Sep 2015
Thanks Given: 15,447
Thanks Received: 15,291


NinjaCat68 View Post
Hello i'm new user from Barcelona..i trade futures on NT8..some good idea,indicators,strategy qnd VPS..i need some help..Thanks EveryBody.

Hi, depending on the help you need you may possibly post in a different thread.

What is it you need help with?

Reply With Quote
  #2795 (permalink)
 
xplorer's Avatar
 xplorer 
London UK
Site Moderator
 
Experience: Beginner
Platform: CQG
Broker: S5
Trading: Futures
Posts: 5,945 since Sep 2015
Thanks Given: 15,447
Thanks Received: 15,291


Big Mike View Post
Alright, should be solved @xplorer and @evevee please confirm.

Seems okay now, thanks.

Reply With Quote
  #2796 (permalink)
 GFIs1 
who cares
Legendary Market Wizard
 
Experience: None
Platform: nobody interested
Broker: none
Trading: forget about it
Posts: 6,921 since Feb 2012
Thanks Given: 6,181
Thanks Received: 15,564

Thanks Mike for the big work on the site!

I find the new speed a tremendous advantage. Then I appreciate the much better function of pasting attachements and Images. And the lost phrase of "why do you udate this post?"-question which is a pain when running one post with several updates during a trade. Finally this helps to streamline the number of posts and all the information is collected in one. I even don't miss the titles for posts - as every user is more open to layout the posts within every thread with an own style. Great!

Seeing your attempt to streamlining the structure of the site with Site Administrator and Site Moderator I might need to change my "Legendary..." into "Site Influencer".

Happy weekend
GFIs1

Follow me on Twitter Visit my NexusFi Trade Journal Reply With Quote
Thanked by:
  #2797 (permalink)
 evevee 
New York
 
Experience: Intermediate
Platform: Ninjatrader
Trading: ES
Posts: 6 since Feb 2012
Thanks Given: 4
Thanks Received: 0

It works. Thanks Mike. Take care.

Reply With Quote
  #2798 (permalink)
 
xplorer's Avatar
 xplorer 
London UK
Site Moderator
 
Experience: Beginner
Platform: CQG
Broker: S5
Trading: Futures
Posts: 5,945 since Sep 2015
Thanks Given: 15,447
Thanks Received: 15,291


Brandenton View Post
I can download, but there is nothing being replayed. Time progresses with no data.

Branderton, I had read this and meant to ask: did you solve this problem?

Reply With Quote
  #2799 (permalink)
 
Brandenton's Avatar
 Brandenton 
Virginia Beach, VA
Legendary Lost At Sea!!
 
Experience: Intermediate
Platform: NinjaTrader
Broker: TopStep
Trading: YM, MYM
Posts: 830 since Sep 2016
Thanks Given: 754
Thanks Received: 1,556


xplorer View Post
Branderton, I had read this and meant to ask: did you solve this problem?

Yup, good to go. Thanks.

Visit my NexusFi Trade Journal Reply With Quote
Thanked by:
  #2800 (permalink)
 
Big Mike's Avatar
 Big Mike 
Manta, Ecuador
Site Administrator
Developer
Swing Trader
 
Experience: Advanced
Platform: Custom solution
Broker: IBKR
Trading: Stocks & Futures
Frequency: Every few days
Duration: Weeks
Posts: 50,399 since Jun 2009
Thanks Given: 33,175
Thanks Received: 101,541


Numerous reports of 503 service errors this morning, should be resolved now. Please advise.

Mike

We're here to help: just ask the community or contact our Help Desk

Quick Links: Change your Username or Register as a Vendor
Searching for trading reviews? Review this list
Lifetime Elite Membership: Sign-up for only $149 USD
Exclusive money saving offers from our Site Sponsors: Browse Offers
Report problems with the site: Using the NexusFi changelog thread
Follow me on Twitter Visit my NexusFi Trade Journal Started this thread Reply With Quote
Thanked by:




Last Updated on March 28, 2024


© 2024 NexusFi™, s.a., All Rights Reserved.
Av Ricardo J. Alfaro, Century Tower, Panama City, Panama, Ph: +507 833-9432 (Panama and Intl), +1 888-312-3001 (USA and Canada)
All information is for educational use only and is not investment advice. There is a substantial risk of loss in trading commodity futures, stocks, options and foreign exchange products. Past performance is not indicative of future results.
About Us - Contact Us - Site Rules, Acceptable Use, and Terms and Conditions - Privacy Policy - Downloads - Top
no new posts