Test Data Discovery or Deluge?

<<the inability of IT to adequately handle test data can create test problems>>

How is this possible, even if true, for which I guarantee is NOT true?

With today's computers wast memory storage, surely there is enough space to save test data, and if capacities cannot be enlarged then simply rate of sampling should be lowered.......

But, WHICH type of >>test data<< we are talking about?

Inability of IT to process test data surely dont exist, if requirement is not real time processing, and even real time sampling and processing should not be impossible if those who test know which data is to be processed and in which way!

Of course that proper tool have to be applied for job at hand, so one cannot expect that handheld device would be able to record Radio Astronomy quantity of data and process them severall ways at once :-))

In our days of wireless communications, such handheld data logger should be sending its measurements to online storage for saving and computer cluster/farm processing, which could also be in Real Time..........

If You have a problem, why dont You state it clearly! If You are ready to hire IT professionall (like me, for instance) to make processing application for Your data, AND You are sure that You know what kind of processing it should be and how should end results be presented, then surely there would be no problems in future with same kind of data!

I have solved problems for which everybody was claiming are unsolwable by contemporary computers in 90es, like >>Traveling Salesman<< problem where for 100 cities it were considered that best computers would have to work 10 or more years at solution, and my ATARI was giving nearly optimall solutions in minutes, while 1000 cities would be calculated in less than two hours.........

Same things were with Neurall Networks where everybody was claiming they are practically unusable because they work too slowly, and I have made program work 1000 times faster on same examples, just because I was professionall programmer and I knew how computers work best, therefore I eliminated double neuron connections as redundant, replaced slowest calculation by fastest (i.e. Multiplication by Left Shift, Division by Right Shift, Floating point variables by Integers and so on...) all of which scientists that invented this programming technique did not take into consideration, or they did not want to spoil beauty of their formulas :-))

I knew this because I started working on computer (mainframe!) with 32 Kilobtes of RAM, with speed measured in hundreds of instructions per minute, and as representative and demonstration center for FUJITSU computers we have to show that our pricipall make better, smaller and faster computers than IBM, Univac, Honeywell, Warian, DEC or other big names........ Severall times I amazed our Japanese instructors by doing things THEY considered >> impossible<<, and those were same people who wrote compilers we were using...........

Therefore I am quite sure that any properly defined and understood problem could be handled by computer programs, and today there is lot of new programing methods that make data analyse easier too, like Neurall Networks, Fuzzy Logic and others ......

Assuming of course that You could use computer with enough RAM and HD space :-) or that I could use it to test program, too!

CR4 ADMIN: This post was edited to remove advertising outside the Commercial Space forum. Please review Section 14 of the CR4 Site FAQ about advertising.