Tune Testing
Posted: Fri Jun 19, 2020 9:32 am
So the ultimate question, the answer to the meaning of it all.....
Which tune is the best?
There is so much noise and real vitriol on the subject, that I'm a little nervous posting about this. I'm posting it here as I think that will keep things calmer, and I can say things like "I don't care what you like; this is about me" and people here seem to be grown up about it.
Honestly my question really is "Which tune is best for me?". To answer this I'm going to do some testing of the tunes I have access to. I have 3 different PCM tunes from 3 very different tuners and I'm going to compare them.
So I think the first part for me is to design the test. I could throw them all on dyno, but that costs money and time and there is the whole dyno setup issue (2 wheels vs 4 wheels, vs 3 wheels) that I don't want to touch. The bigger concern for me though is does a dyno pull translate to what I want out of my car. A dyno is a hugely useful tool to see what the powertrain is doing, I don't think it's reasonable to expect a good tuner not to use one. My plan however is to examine how the tune works for me. I don't live my life one 1/4 mile at a time. I'm not a track day warrior, driving on the track requires patience and mental discipline that I seem to have less and less time for as I get older. So I'm an enthusiastic driver who learned to drive on the mountain roads in Wales and gets the most enjoyment managing a car through the twisty stuff. Probably closest to hill climbing, but without the desire to die.
So what does that translate to for me and this test. Ultimately the goal is to figure out how to shake Sportfan off my tail at the next Twisted Sisters event. Here's my initial thoughts:
- I think I need to look at how the cars pulls from 20mph to 50mph in 2nd gear. That equates to me exiting a slow corner properly.
- I probably need to look at a similar pull in 3rd gear, (going to play with that a little and see what I think is appropriate). I'm hoping this will equate to picking the wrong gear in a slow turn but still wanting to leave Sportfan behind. Also perhaps looking at how the car comes off half throttle in 3rd and goes forth.
- Probably 60 to a speeding ticket in 4th, because I can.
I'm going to datalog with my Kiwi3 and Dashcommand combo (keep it simple stupid), and going to log:
- time
- speed
- IATs and ambient temps
- timing
- boost
- throttle pedal position (if I have that, I need to check)
- throttle body position
- AFR (because I want to make sure my car isn't going to die)
I'll try to run each tune at about the same time of day, and avoid any extreme weather variations (tough to do in the Gulf Coast). I can always rerun a tune if it looks like one didn't get a fair shake. I'll only run one tune each day, so the car will be totally cooled down and I'll run the same warm up route to the testing area. If I end up having to change anything, plugs etc, I'll rerun all the tests for a level playing field.
As I run each tune I'll post the results without identifying the tuner, so that each tuner has a chance to address any feedback and add to the tunes (especially in the new tunes that have never been tested on my car before). I think this will also avoid external bias when you are looking at the data. I'll know but I can't think of a way around that without letting someone else put the tunes on. It will be interesting to see if I can even tell the difference, it is strange how much your brain can invent power increases when they don't exist.
When everything is complete then I'll identify the tuner and their results, as well as announcing my favorite.
My cars current power train configuration is as follows:
Car is a 2013 500c Abarth.
NGen Performance turbo (11 blade)
Ported/polished manifold
Supersprint hi-flow cat and exhaust
C&B cam
Forge WGA & BOV
ATM fenderwell intake
ATM FMIC
EC boost leak fix
93 octane gas
I also have a water/meth kit and Tork MA springs that I might add later just to see if the impacts can be measured.
So, what are your thoughts about the testing? Am I missing anything? I'm doing it anyway, even if you're not interested.
I also thought about picking up a used piggyback for comparison, so let me know if you see anything out there.
I'm going to run the tests with a stock tune tomorrow, as a baseline, assuming the weather cooperates and assuming I install one or more seats today.
Which tune is the best?
There is so much noise and real vitriol on the subject, that I'm a little nervous posting about this. I'm posting it here as I think that will keep things calmer, and I can say things like "I don't care what you like; this is about me" and people here seem to be grown up about it.
Honestly my question really is "Which tune is best for me?". To answer this I'm going to do some testing of the tunes I have access to. I have 3 different PCM tunes from 3 very different tuners and I'm going to compare them.
So I think the first part for me is to design the test. I could throw them all on dyno, but that costs money and time and there is the whole dyno setup issue (2 wheels vs 4 wheels, vs 3 wheels) that I don't want to touch. The bigger concern for me though is does a dyno pull translate to what I want out of my car. A dyno is a hugely useful tool to see what the powertrain is doing, I don't think it's reasonable to expect a good tuner not to use one. My plan however is to examine how the tune works for me. I don't live my life one 1/4 mile at a time. I'm not a track day warrior, driving on the track requires patience and mental discipline that I seem to have less and less time for as I get older. So I'm an enthusiastic driver who learned to drive on the mountain roads in Wales and gets the most enjoyment managing a car through the twisty stuff. Probably closest to hill climbing, but without the desire to die.
So what does that translate to for me and this test. Ultimately the goal is to figure out how to shake Sportfan off my tail at the next Twisted Sisters event. Here's my initial thoughts:
- I think I need to look at how the cars pulls from 20mph to 50mph in 2nd gear. That equates to me exiting a slow corner properly.
- I probably need to look at a similar pull in 3rd gear, (going to play with that a little and see what I think is appropriate). I'm hoping this will equate to picking the wrong gear in a slow turn but still wanting to leave Sportfan behind. Also perhaps looking at how the car comes off half throttle in 3rd and goes forth.
- Probably 60 to a speeding ticket in 4th, because I can.
I'm going to datalog with my Kiwi3 and Dashcommand combo (keep it simple stupid), and going to log:
- time
- speed
- IATs and ambient temps
- timing
- boost
- throttle pedal position (if I have that, I need to check)
- throttle body position
- AFR (because I want to make sure my car isn't going to die)
I'll try to run each tune at about the same time of day, and avoid any extreme weather variations (tough to do in the Gulf Coast). I can always rerun a tune if it looks like one didn't get a fair shake. I'll only run one tune each day, so the car will be totally cooled down and I'll run the same warm up route to the testing area. If I end up having to change anything, plugs etc, I'll rerun all the tests for a level playing field.
As I run each tune I'll post the results without identifying the tuner, so that each tuner has a chance to address any feedback and add to the tunes (especially in the new tunes that have never been tested on my car before). I think this will also avoid external bias when you are looking at the data. I'll know but I can't think of a way around that without letting someone else put the tunes on. It will be interesting to see if I can even tell the difference, it is strange how much your brain can invent power increases when they don't exist.
When everything is complete then I'll identify the tuner and their results, as well as announcing my favorite.
My cars current power train configuration is as follows:
Car is a 2013 500c Abarth.
NGen Performance turbo (11 blade)
Ported/polished manifold
Supersprint hi-flow cat and exhaust
C&B cam
Forge WGA & BOV
ATM fenderwell intake
ATM FMIC
EC boost leak fix
93 octane gas
I also have a water/meth kit and Tork MA springs that I might add later just to see if the impacts can be measured.
So, what are your thoughts about the testing? Am I missing anything? I'm doing it anyway, even if you're not interested.
I also thought about picking up a used piggyback for comparison, so let me know if you see anything out there.
I'm going to run the tests with a stock tune tomorrow, as a baseline, assuming the weather cooperates and assuming I install one or more seats today.