Download software Tutorial videos
Subscription & data-feed pricing Class schedule


New account application Trading resources
Margin rates Stock & option commissions

Attention: Discussion forums are read-only for extended maintenance until further notice.
Welcome Guest, please sign in to participate in a discussion. Search | Active Topics |

Efficient Use of CPUs Rate this Topic:
Previous Topic · Next Topic Watch this topic · Print this topic ·
danielbender
Posted : Friday, May 21, 2010 3:32:01 PM
Registered User
Joined: 1/14/2006
Posts: 436
I have a computer with 8 CPUs.  From time to time, I ask it to sort on a watchlist column that is computationally intensive.   It takes several minutes.   When I check my Windows Task Manager, it shows that only 1 of the 8 processors is working on the sorting task. 

Are you going to optimize StockFinder so that it will utilize multiple CPUs for computationally intensive tasks such as the one described above?

Thank you ... Dan
pthegreat
Posted : Sunday, May 23, 2010 3:33:56 PM

Registered User
Joined: 6/15/2008
Posts: 1,356
8 CPU's? wow. what mother-board do you use? or do you mean you have a quad-core CPU?
danielbender
Posted : Monday, May 24, 2010 2:15:27 AM
Registered User
Joined: 1/14/2006
Posts: 436
Quadcore Intel i7 920
Kuf
Posted : Monday, May 24, 2010 10:21:34 AM


Administration

Joined: 9/18/2004
Posts: 3,522
Sorting currently uses only 1 processor. It's on our list to optimize sorts and scans for multiple cores.  Charting, however, does use multiple processors.  

And the quad i7 has 4 cores  with hyperthreading (2 threads per core), so it appears to the system to have 8 cpus.

Ken Gilb (Kuf)
Chief Software Engineer - Worden Brothers Inc.
Try/Catch - My RealCode Blog
jas0501
Posted : Monday, May 24, 2010 10:53:05 AM
Registered User
Joined: 12/31/2005
Posts: 2,499
QUOTE (Kuf)
Sorting currently uses only 1 processor. It's on our list to optimize sorts and scans for multiple cores.  Charting, however, does use multiple processors.  

And the quad i7 has 4 cores  with hyperthreading (2 threads per core), so it appears to the system to have 8 cpus.


So is my  Intel Core 2 Duo Cpu using hyperthreading when I see the CPU usage of StockFinder over 50%? At times when encountering the startup memory leak issue the CPU usage is above 75% when the column sort is processing. Since nothing else is going on it appears that there are multiple sorts being processed.

Is it possible that the hyperthreading usage for columns sorts is being tripped up on static memory usage in the column. There is something funky going on with column sorts sometimes. In trying to get a better handle on the issue I encounterd issue with ActiveList.SymbolCount and ActiveList.isLastSymbol, see Bug: problem with ActiveList features and Bug: watchlist column sort chage of direction start 2nd sort process and Bug: multiple instances of a column sort process
Kuf
Posted : Monday, May 24, 2010 12:54:26 PM


Administration

Joined: 9/18/2004
Posts: 3,522
Let me rephrase, sorting will currently use 1 processor per WatchList. 2 of those 3 bugs you listed jas have been fixed, and the ActiveList one is only implemented for Market Indicators.

Ken Gilb (Kuf)
Chief Software Engineer - Worden Brothers Inc.
Try/Catch - My RealCode Blog
danielbender
Posted : Monday, May 24, 2010 2:38:05 PM
Registered User
Joined: 1/14/2006
Posts: 436
Ken - What is the ETA for multiple-core charting and scanning?  Thanks
Kuf
Posted : Monday, May 24, 2010 5:01:38 PM


Administration

Joined: 9/18/2004
Posts: 3,522
StockFinder already uses multiple cores for charting.   It will also use multiple cores if you have more than one filter/scan running, it will not however use multiple cores for one single scan.

Ken Gilb (Kuf)
Chief Software Engineer - Worden Brothers Inc.
Try/Catch - My RealCode Blog
pthegreat
Posted : Monday, June 7, 2010 11:14:32 PM

Registered User
Joined: 6/15/2008
Posts: 1,356

Just a FYI, I recently replaced my harddrive for a crucial C300 SATA drive, with Win 7. me to, use a I7 920 processor on a 64bit ASUS P6t motherboard and 12Gb RAM. 
Changing to the SATA drive, had a huge impact. before, during market hours, I had sluggish response on my sorts, and slow response on the software itself,

Now its flying. I'm planning on overclocking the CPU, which hopefully allow me to run more sorts on more watchlists.

pthegreat
Posted : Monday, June 7, 2010 11:20:08 PM

Registered User
Joined: 6/15/2008
Posts: 1,356
this website made me switch to the Crucial drive:
http://www.cpubenchmark.net/

great info on finding the best possible configuration on motherboards, CPU's, drives.
pthegreat
Posted : Tuesday, April 17, 2012 2:38:04 PM

Registered User
Joined: 6/15/2008
Posts: 1,356

Kuff/Bruce,

I'm working on building a new PC. I have a few questions in regards to the current release of stockfinder and the 5.1 release :

- I understand that currently SF supports mult-core for charting, and one core per scan/sort. Is there any limitation in how many cores it can use?

- will the final version be 32 or 64 bit? and will it support multi-core for scans/sorts as has been stated in previous posts?

- any ETA on the final version???

thanks,

P.

 

pthegreat
Posted : Tuesday, April 17, 2012 4:04:55 PM

Registered User
Joined: 6/15/2008
Posts: 1,356

What I'm really getting at is what would work better:

dual CPU motherboard with 2 CPU's each with 12cores, running at 2.5Ghz, or single CPU, 12cores running at 4.5Ghz.

My goal is to be able to have multiple charts open, and have multiple condition columns in at least one watchlist, or maybe two.

I have my current layout maxed out at 3 charts, one watchlist, with 10 columns. running on a intel I7 920 CPU (8core) overclocked at 4Ghz.

Would like to increase to 6 or so charts. I would assume I have a better chance in getting a setup with as much cores as possible, even if they run at a slightly lower clock frequency, correct?

Bruce_L
Posted : Tuesday, April 17, 2012 4:30:09 PM


Worden Trainer

Joined: 10/7/2004
Posts: 65,138

All of our development efforts are currently focused on TC2000 version 12.1 and I could not say when StockFinder 5.1 might be finalized or if it will have a 64-bit version available when it is.

I do not know the answers to any of your other questions and cannot tell you which computer setup would work best. While I have made inquiries, at this point, this is all I can tell you.



-Bruce
Personal Criteria Formulas
TC2000 Support Articles
Winnie
Posted : Tuesday, April 17, 2012 8:44:14 PM
Registered User
Joined: 10/7/2004
Posts: 1,006

Not sure if this helps, I built my last system in December 2010 below are the hardware components.  I have no problem running StockFinder 5.1, with four 22” digital monitors, stacked in two rows, one on top of each other. I have not OC the CPU, CPU cores run cool, 32-39 degree C.

I have a high speed Internet setup, Download speed 49-60 Mbps and Upload speed 7-9 Mbps.

The only issue is StockFinder does not support Microsoft stacked display layout therefore moving the curser becomes a little unintuitive.

The Layout, besides the Main Chart with 3 Indicators on one monitor, I have two smaller charts with my IB TWS interface on another monitor, my Main WatchList with 21 columns, plus three other WatchLists with 6-10 columns on the other two monitors.

 

Computer     Asus    P6X58D Premium (December 2010)

Description

Manufacturer

Qty

Model

Case

Lian Li

1

PC-B10

PSU

Corsair

1

HX750W

MB

Asus

1

P6X58D Premium

CPU

Intel

1

Core i7 980x - BX80613i7980X

Air Cooler

Prolimatech

1

Megahalems Rev.B

Memory

Kingston

1

KHX1600C9D3K3/12GX (12GB:3x4GB)

Video Card

XFX

1

HD-577X-Z5F3

MDP to DVI

Accell

4

B087B-006B (Active Mini DP)

Optical Dr

LG

1

WH10LS30K (Blu-Ray, DVDRW )

Monitors

Dell

4

SP2208WFP

Mobile Rack

Lian Li

3

Mobile Rack HD-RH-48B

Mouse

Microsoft

1

Wireless Laser Mouse 8000

Modem

Motorola

1

SB6120 SURFboard            

Router

Netgear

1

Rangemax WNDR3700 Dual Band

HD

WD

3

Black Caviar WD6402AAEX (640GB)

OS

Microsoft

1

Windows7 Ultimate 64bit

 

 

 

 

 

pthegreat
Posted : Monday, April 23, 2012 6:42:19 PM

Registered User
Joined: 6/15/2008
Posts: 1,356

Couple of tips and tricks to optimize your multi-core hardware for Stockfinder. It goes without saying that first, one has to optimize stockfinder as much as you can, which has been discussed in other threads.

Simple trick to see how mult-cores affect Sf is by running your PC on a single core.

In the start search box type msconfig, goto the boot menu, and select advanced options.

at default the number of processors should be disabled. enable it, and now you can select how many processors you want to use. After applying and rebooting, you'll see that SF runs considerably slower.

http://screencast.com/t/lDgzfNou3

Don't forget to disable this setting again after your test.

Some tricks I have found usefull :

At default Windows uses "parking" of processors to save power, and who knows what other reason. This means that not all processors are available at all times.

you can see this in your task manager:

press Ctrl-Alt-Del, and select task manager.  select "performance" from the menu, then "resource monitor"

http://screencast.com/t/HdwobOob8

You will see that some of your processors are parked, and are at 0% utilisation.

Here's a link that shows you how to disable the parking;

http://pcmichiana.com/disable-cpu-core-parking-for-multi-core-processors-faster-7-episode-20/

The downside of doing this is that the CPU runs at 100% all the time, and therefore uses more power, and generates more heat. I have replaced my factory installed CPU cooler with a larger one, so I don't care.

Another usefull tip is to use a software utility called "prio" that will allow you to priorize processes.

http://www.prnwatch.com/prio.html

With this utility I have changed the StockfinderApp and BlocksDataDownloader processes to a High Cpu priority.

Although I have my CPU, an Intel I7 920, overclocked from 2.6Ghz to 4Ghz. I don't see as much improvement as when I make sure that my system runs on all cores. (my test as described above proofed it).  In the Resource Monitor I see that SF uses at maximum around 50 threads.

So my conclusion would be that if I want higher performance, SF would benefit more from adding cores, then increasing CPU frequency.

therefore I'm looking to get a motherboard that supports dual, or maybe even quad physical CPU's. Probably one that supports the AMD Opteron processors, they are relatively cheap, and support from 8 to 16 cores per CPU.

 

Bruce, please let me know if your developers support this thinking.

thanks,

P.

 

 

 

 

 

 

 

Bruce_L
Posted : Tuesday, April 24, 2012 11:12:41 AM


Worden Trainer

Joined: 10/7/2004
Posts: 65,138

Your testing seems quite good. I have reached out to see if I can get additional comment on this topic, but we would not normally recommend specific hardware.



-Bruce
Personal Criteria Formulas
TC2000 Support Articles
Flash99
Posted : Wednesday, May 16, 2012 9:45:03 PM
Platinum Customer Platinum Customer

Joined: 7/16/2009
Posts: 411

I found that the best way to improve SF5 performance is to limit the number of  Daily & Intraday bars.

There is no hardware that can match the performance improvement you get by reducing these 2 numbers. I run SF5 with 80 Daily & 120 Intraday bars, and it's flying.

pthegreat
Posted : Wednesday, May 16, 2012 10:03:43 PM

Registered User
Joined: 6/15/2008
Posts: 1,356

Hey Flash,  yes I have reduced it as much as I can, I use intraday charts, and want to see at least two days of data.

Quite an interesting test I did recently, for the ones interested, :

used a motherboard with dual Opteron 6282SE 16core/16threads CPU's, for a total of 32cores/threads, at 2.6Ghz clock speed, and guess what. My layout was unusable during market hours. while it runs fine on my single intel I7 920 quad core CPU.  Go Figure !

i thought SF was designed around multi-threading, and thus my thinking was, to throw more cores.threads at it.

pthegreat
Posted : Saturday, June 2, 2012 2:21:30 AM

Registered User
Joined: 6/15/2008
Posts: 1,356

I have changed to a single physical CPU socket motherboard. An Asus Rampage IV, and equipped it with the latest high end intel I7 processor : I7-3930K. which has 6cores/12 threads, and a base clock of 3.2Ghz. I have overclocked it to 5Ghz, using top-end watercooling system in a large case. Results are fantastic, I can now add more charts to my layout, and it is very responsive during trading hours.

I'm not proclaiming that in order to use SF you need an extreme computer system. I happen to have a layout that uses several indicators/conditions that are very CPU intensive, and I want to have several intraday charts open, so I don't have to spacebar through my watchlist continuously. Just trying to push the envelope.

If you're like me, and try to squeeze every little "bit" out of your system, then also make sure you have an adequate power supply. specially with multiple intraday charts, and conditions, you're CPU is doing overwork, and requires more power. on my previous system I had two to three crashes a day, until I exchanged my power supply for a 1000watt unit. . With my new system I have a 1200Watt unit. Also an online UPS is recommended. I noticed that at least a couple of times a day, the UPS would kick in, due to wall-power fluctuations. After these changes not a single crash.

 

 

Users browsing this topic
Guest-1

Forum Jump
You cannot post new topics in this forum.
You cannot reply to topics in this forum.
You cannot delete your posts in this forum.
You cannot edit your posts in this forum.
You cannot create polls in this forum.
You cannot vote in polls in this forum.