NexusFi: Find Your Edge


Home Menu

 





NexusFi site changelog and issues/problem reporting


Discussion in Feedback and Announcements

Updated
      Top Posters
    1. looks_one Big Mike with 2,157 posts (3,889 thanks)
    2. looks_two bobwest with 255 posts (491 thanks)
    3. looks_3 xplorer with 232 posts (387 thanks)
    4. looks_4 SMCJB with 99 posts (109 thanks)
      Best Posters
    1. looks_one bobwest with 1.9 thanks per post
    2. looks_two Big Mike with 1.8 thanks per post
    3. looks_3 xplorer with 1.7 thanks per post
    4. looks_4 SMCJB with 1.1 thanks per post
    1. trending_up 1,170,941 views
    2. thumb_up 6,320 thanks given
    3. group 165 followers
    1. forum 3,895 posts
    2. attach_file 559 attachments




 
Search this Thread

NexusFi site changelog and issues/problem reporting

  #2791 (permalink)
NinjaCat68
Blanes+ Girona/Spain
 
Posts: 2 since Jun 2020
Thanks Given: 8
Thanks Received: 0

Hello i'm new user from Barcelona..i trade futures on NT8..some good idea,indicators,strategy qnd VPS..i need some help..Thanks EveryBody.
Big Mike View Post
The above was due to hardware changes for the site. I migrated to:

- 10th gen CPU, i9-10900X
- 128GB memory
- 8TB NVMe drive

As I mentioned many pages back as something I wanted to do... I left Google Cloud Compute and reverted back to something far simpler. Instead of a triple node MariaDB Galera replication system, with multiple physical nodes for the application servers, I reverted back to something that served us well for years. A single node setup.

Just like trading, you have to always be learning. The reason I went with GCP in the first place was because of rolling hardware upgrades and reliability, both having been the weak point of our old setup (aging hardware).

However, that aging hardware was mostly because we owned it and we co-lo'd into a datacenter. If I didn't own the hardware, I would have been more willing to ditch it earlier and upgrade in between Intel release cycles.

But GCP added complexity that proved to not solve problems for us, but create them, and it was also noticeably slower due to optimization for mutli-core deployments but at slower clock rates.

So I searched and found a high-clock rate replacement better suited for our workload. Less cores, but higher clock. I went with an i9-10900X for its stability, in a server class motherboard. Sure, we give up ECC ram but my experience tells me it's not important in real-world, where higher clock certainly is.

I also upgraded to an 8TB NVMe, specifically the HGST SN200. It can do 1.2M IOPS and 6GB/sec transfer, a significant improvement over anything we've had before.

When you look at our biggest threads, like the SP500 Spoonalysis thread, it was taking 2.5-3.0 seconds to load per page on the GCP hardware. Now we are down to less than 1 second, a massive improvement.

You should also see similar performance gains when creating a new post, as that was one of the slower aspects of the old system as well. The current bottleneck in that regard is related to the number of Followers in the thread, as notifications are processed in real-time when you submit the post (architecture of vb 3.8).

Since we gave up triple node redundancy with Galera, I am instead doing real-time hot backups of the databases using mydumper, combined with real-time file system sync using lsyncd. We have a much smaller backup node on a private VLAN at the same datacenter, to hold our backups and with the ability to step in at any time to replace the master in an emergency.

Anyway, having moved to Dockerized containers a while back, there is no real issue migrating from one host to another any longer. But please do report any problems, nonetheless.

Mike

Sent using the NexusFi mobile app

Reply With Quote

Can you help answer these questions
from other members on NexusFi?
Better Renko Gaps
The Elite Circle
Pivot Indicator like the old SwingTemp by Big Mike
NinjaTrader
ZombieSqueeze
Platforms and Indicators
Exit Strategy
NinjaTrader
NT7 Indicator Script Troubleshooting - Camarilla Pivots
NinjaTrader
 
Best Threads (Most Thanked)
in the last 7 days on NexusFi
Just another trading journal: PA, Wyckoff & Trends
27 thanks
Diary of a simple price action trader
26 thanks
Tao te Trade: way of the WLD
23 thanks
My NQ Trading Journal
14 thanks
HumbleTraders next chapter
9 thanks
  #2792 (permalink)
 
Big Mike's Avatar
 Big Mike 
Manta, Ecuador
Site Administrator
Developer
Swing Trader
 
Experience: Advanced
Platform: Custom solution
Broker: IBKR
Trading: Stocks & Futures
Frequency: Every few days
Duration: Weeks
Posts: 50,440 since Jun 2009
Thanks Given: 33,207
Thanks Received: 101,599


xplorer View Post
Yep, there seems to be a problem with some of the downloads




Alright, I've duplicated the problem. Let me see what is causing it...

Mike

We're here to help: just ask the community or contact our Help Desk

Quick Links: Change your Username or Register as a Vendor
Searching for trading reviews? Review this list
Lifetime Elite Membership: Sign-up for only $149 USD
Exclusive money saving offers from our Site Sponsors: Browse Offers
Report problems with the site: Using the NexusFi changelog thread
Follow me on Twitter Visit my NexusFi Trade Journal Started this thread Reply With Quote
Thanked by:
  #2793 (permalink)
 
Big Mike's Avatar
 Big Mike 
Manta, Ecuador
Site Administrator
Developer
Swing Trader
 
Experience: Advanced
Platform: Custom solution
Broker: IBKR
Trading: Stocks & Futures
Frequency: Every few days
Duration: Weeks
Posts: 50,440 since Jun 2009
Thanks Given: 33,207
Thanks Received: 101,599



Big Mike View Post
Alright, I've duplicated the problem. Let me see what is causing it...

Mike

Alright, should be solved @xplorer and @evevee please confirm.

Was an issue with 512-byte sector vs 4k sector alignment with XFS, when we migrated servers last time apparently we switched from a 512-byte sector to a 4k sector and nginx AIO/directio flag wasn't aligned properly.

I've been sick all week so haven't been on the site which is why it took so long to resolve. Plus this only affected files larger than 32M which is a minority.

Mike

We're here to help: just ask the community or contact our Help Desk

Quick Links: Change your Username or Register as a Vendor
Searching for trading reviews? Review this list
Lifetime Elite Membership: Sign-up for only $149 USD
Exclusive money saving offers from our Site Sponsors: Browse Offers
Report problems with the site: Using the NexusFi changelog thread
Follow me on Twitter Visit my NexusFi Trade Journal Started this thread Reply With Quote
Thanked by:
  #2794 (permalink)
 
xplorer's Avatar
 xplorer 
London UK
Site Moderator
 
Experience: Beginner
Platform: CQG
Broker: S5
Trading: Futures
Posts: 5,970 since Sep 2015
Thanks Given: 15,475
Thanks Received: 15,367


NinjaCat68 View Post
Hello i'm new user from Barcelona..i trade futures on NT8..some good idea,indicators,strategy qnd VPS..i need some help..Thanks EveryBody.

Hi, depending on the help you need you may possibly post in a different thread.

What is it you need help with?

Reply With Quote
  #2795 (permalink)
 
xplorer's Avatar
 xplorer 
London UK
Site Moderator
 
Experience: Beginner
Platform: CQG
Broker: S5
Trading: Futures
Posts: 5,970 since Sep 2015
Thanks Given: 15,475
Thanks Received: 15,367


Big Mike View Post
Alright, should be solved @xplorer and @evevee please confirm.

Seems okay now, thanks.

Reply With Quote
  #2796 (permalink)
 GFIs1 
who cares
Legendary Market Wizard
 
Experience: None
Platform: nobody interested
Broker: none
Trading: forget about it
Posts: 6,931 since Feb 2012
Thanks Given: 6,195
Thanks Received: 15,578

Thanks Mike for the big work on the site!

I find the new speed a tremendous advantage. Then I appreciate the much better function of pasting attachements and Images. And the lost phrase of "why do you udate this post?"-question which is a pain when running one post with several updates during a trade. Finally this helps to streamline the number of posts and all the information is collected in one. I even don't miss the titles for posts - as every user is more open to layout the posts within every thread with an own style. Great!

Seeing your attempt to streamlining the structure of the site with Site Administrator and Site Moderator I might need to change my "Legendary..." into "Site Influencer".

Happy weekend
GFIs1

Follow me on Twitter Visit my NexusFi Trade Journal Reply With Quote
Thanked by:
  #2797 (permalink)
 evevee 
New York
 
Experience: Intermediate
Platform: Ninjatrader
Trading: ES
Posts: 6 since Feb 2012
Thanks Given: 4
Thanks Received: 0

It works. Thanks Mike. Take care.

Reply With Quote
  #2798 (permalink)
 
xplorer's Avatar
 xplorer 
London UK
Site Moderator
 
Experience: Beginner
Platform: CQG
Broker: S5
Trading: Futures
Posts: 5,970 since Sep 2015
Thanks Given: 15,475
Thanks Received: 15,367


Brandenton View Post
I can download, but there is nothing being replayed. Time progresses with no data.

Branderton, I had read this and meant to ask: did you solve this problem?

Reply With Quote
  #2799 (permalink)
 
Brandenton's Avatar
 Brandenton 
Virginia Beach, VA
 
Experience: Intermediate
Platform: NinjaTrader
Broker: TopStep
Trading: YM, MYM
Posts: 831 since Sep 2016
Thanks Given: 755
Thanks Received: 1,557


xplorer View Post
Branderton, I had read this and meant to ask: did you solve this problem?

Yup, good to go. Thanks.

Visit my NexusFi Trade Journal Reply With Quote
Thanked by:
  #2800 (permalink)
 
Big Mike's Avatar
 Big Mike 
Manta, Ecuador
Site Administrator
Developer
Swing Trader
 
Experience: Advanced
Platform: Custom solution
Broker: IBKR
Trading: Stocks & Futures
Frequency: Every few days
Duration: Weeks
Posts: 50,440 since Jun 2009
Thanks Given: 33,207
Thanks Received: 101,599


Numerous reports of 503 service errors this morning, should be resolved now. Please advise.

Mike

We're here to help: just ask the community or contact our Help Desk

Quick Links: Change your Username or Register as a Vendor
Searching for trading reviews? Review this list
Lifetime Elite Membership: Sign-up for only $149 USD
Exclusive money saving offers from our Site Sponsors: Browse Offers
Report problems with the site: Using the NexusFi changelog thread
Follow me on Twitter Visit my NexusFi Trade Journal Started this thread Reply With Quote
Thanked by:




Last Updated on April 15, 2024


© 2024 NexusFi™, s.a., All Rights Reserved.
Av Ricardo J. Alfaro, Century Tower, Panama City, Panama, Ph: +507 833-9432 (Panama and Intl), +1 888-312-3001 (USA and Canada)
All information is for educational use only and is not investment advice. There is a substantial risk of loss in trading commodity futures, stocks, options and foreign exchange products. Past performance is not indicative of future results.
About Us - Contact Us - Site Rules, Acceptable Use, and Terms and Conditions - Privacy Policy - Downloads - Top
no new posts