mark_h
17th October 2012, 19:46
Thought I would try this forum first to see if anyone has seen anything like this for this session or others. We have a case where tibom1213m000(Detect Low Level Code) has been increasing in run for months. You can see the chart below. We moved to new equipment in November of 2011 and expected a slight increase. Now it kept increasing until April 6th - we cannot figure out what happened on April 6th 2012 to drop the run time back down to about 40 minutes. The run times continue to grow for this session is now over 6 hours. Any clues? Of course nobody claims to have made any changes that weekend for the run.

We logged a ticket with infor and they basically said I/O was the issue - but we have been on the same hardware and storage up until about two weeks ago. At that time we moved from tier 2 storage to tier 1 storage(I don't have the types of drives or any information around this). As it was a lot of other things perform great now, but this job continues to grow. Anything anyone can think of to look at?

We have two sessions showing this trend tibom1213m000 and calculate cost prices - don't have the session number handy. We are going to try exporting and importing the main tables for the session this weekend. See what happens after that. We did just clone our production company a couple of weeks ago - this session runs under 1 hour all test environments and in 30 minutes in the recently cloned copy(export/import basically). OH - database is Oracle 10g. Any clues or thoughts appreciated.

30 tibom1213m10b Update Low Level Codes and Detect Loops No 08-05-2011 17:14 08-05-2011 17:45 101 0.52
30 tibom1213m10b Update Low Level Codes and Detect Loops No 08-12-2011 17:14 08-12-2011 17:49 101 0.58
30 tibom1213m10b Update Low Level Codes and Detect Loops No 08-19-2011 17:14 08-19-2011 17:52 101 0.63
30 tibom1213m10b Update Low Level Codes and Detect Loops No 08-26-2011 19:18 08-26-2011 19:58 101 0.67
30 tibom1213m10b Update Low Level Codes and Detect Loops No 09-02-2011 17:14 09-02-2011 17:59 101 0.75
30 tibom1213m10b Update Low Level Codes and Detect Loops No 09-09-2011 17:14 09-09-2011 18:04 101 0.83
30 tibom1213m10b Update Low Level Codes and Detect Loops No 09-16-2011 17:16 09-16-2011 18:12 101 0.93
30 tibom1213m10b Update Low Level Codes and Detect Loops No 09-23-2011 17:14 09-23-2011 18:11 101 0.95
30 tibom1213m10b Update Low Level Codes and Detect Loops No 09-30-2011 17:18 09-30-2011 18:29 101 1.18
30 tibom1213m10b Update Low Level Codes and Detect Loops No 10-07-2011 17:14 10-07-2011 18:17 101 1.05
30 tibom1213m10b Update Low Level Codes and Detect Loops No 10-14-2011 17:14 10-14-2011 18:17 101 1.05
30 tibom1213m10b Update Low Level Codes and Detect Loops No 10-23-2011 17:52 10-23-2011 20:36 101 2.73
30 tibom1213m10b Update Low Level Codes and Detect Loops No 10-29-2011 02:21 10-29-2011 05:26 101 3.08
30 tibom1213m10b Update Low Level Codes and Detect Loops No 11-04-2011 17:13 11-04-2011 20:20 101 3.12
30 tibom1213m10b Update Low Level Codes and Detect Loops No 11-11-2011 17:16 11-11-2011 21:02 101 3.77
30 tibom1213m10b Update Low Level Codes and Detect Loops No 11-18-2011 17:16 11-18-2011 20:48 101 3.53
30 tibom1213m10b Update Low Level Codes and Detect Loops No 11-25-2011 17:15 11-25-2011 20:52 101 3.62
30 tibom1213m10b Update Low Level Codes and Detect Loops No 12-02-2011 17:18 12-02-2011 21:14 101 3.93
30 tibom1213m10b Update Low Level Codes and Detect Loops No 12-09-2011 17:12 12-09-2011 20:58 101 3.77
30 tibom1213m10b Update Low Level Codes and Detect Loops No 12-16-2011 17:11 12-16-2011 21:18 101 4.12
30 tibom1213m10b Update Low Level Codes and Detect Loops No 12-23-2011 17:11 12-23-2011 21:16 101 4.08
30 tibom1213m10b Update Low Level Codes and Detect Loops No 12-30-2011 17:11 12-30-2011 21:42 101 4.52
30 tibom1213m10b Update Low Level Codes and Detect Loops No 01-06-2012 17:11 01-06-2012 21:40 101 4.48
30 tibom1213m10b Update Low Level Codes and Detect Loops No 01-13-2012 17:12 01-13-2012 21:57 101 4.75
30 tibom1213m10b Update Low Level Codes and Detect Loops No 01-20-2012 17:11 01-20-2012 22:01 101 4.83
30 tibom1213m10b Update Low Level Codes and Detect Loops No 01-27-2012 17:12 01-27-2012 22:32 101 5.33
30 tibom1213m10b Update Low Level Codes and Detect Loops No 02-03-2012 17:11 02-03-2012 22:28 101 5.28
30 tibom1213m10b Update Low Level Codes and Detect Loops No 02-10-2012 17:12 02-10-2012 23:00 101 5.80
30 tibom1213m10b Update Low Level Codes and Detect Loops No 02-17-2012 17:11 02-17-2012 22:44 101 5.55
30 tibom1213m10b Update Low Level Codes and Detect Loops No 02-24-2012 17:11 02-24-2012 22:53 101 5.70
30 tibom1213m10b Update Low Level Codes and Detect Loops No 03-02-2012 17:53 03-02-2012 23:50 101 5.95
30 tibom1213m10b Update Low Level Codes and Detect Loops No 03-09-2012 17:13 03-09-2012 23:20 101 6.12
30 tibom1213m10b Update Low Level Codes and Detect Loops No 03-16-2012 17:13 03-16-2012 23:28 101 6.25
30 tibom1213m10b Update Low Level Codes and Detect Loops No 03-23-2012 17:13 03-23-2012 23:40 101 6.45
30 tibom1213m10b Update Low Level Codes and Detect Loops No 03-30-2012 17:13 03-30-2012 23:52 101 6.65
30 tibom1213m10b Update Low Level Codes and Detect Loops No 04-06-2012 17:14 04-06-2012 17:53 101 0.65
30 tibom1213m10b Update Low Level Codes and Detect Loops No 04-13-2012 17:13 04-13-2012 17:58 101 0.75
30 tibom1213m10b Update Low Level Codes and Detect Loops No 04-20-2012 17:13 04-20-2012 18:09 101 0.93
30 tibom1213m10b Update Low Level Codes and Detect Loops No 04-27-2012 17:13 04-27-2012 18:17 101 1.07
30 tibom1213m10b Update Low Level Codes and Detect Loops No 05-04-2012 17:14 05-04-2012 18:28 101 1.23
30 tibom1213m10b Update Low Level Codes and Detect Loops No 05-11-2012 17:14 05-11-2012 18:43 101 1.48
30 tibom1213m10b Update Low Level Codes and Detect Loops No 05-18-2012 17:14 05-18-2012 18:53 101 1.65
30 tibom1213m10b Update Low Level Codes and Detect Loops No 05-25-2012 17:13 05-25-2012 19:05 101 1.87
30 tibom1213m10b Update Low Level Codes and Detect Loops No 06-01-2012 17:14 06-01-2012 19:12 101 1.97
30 tibom1213m10b Update Low Level Codes and Detect Loops No 06-08-2012 17:13 06-08-2012 19:22 101 2.15
30 tibom1213m10b Update Low Level Codes and Detect Loops No 06-15-2012 17:14 06-15-2012 19:33 101 2.32
30 tibom1213m10b Update Low Level Codes and Detect Loops No 06-22-2012 17:14 06-22-2012 19:44 101 2.50
30 tibom1213m10b Update Low Level Codes and Detect Loops No 06-29-2012 17:13 06-29-2012 19:56 101 2.72
30 tibom1213m10b Update Low Level Codes and Detect Loops No 07-06-2012 17:14 07-06-2012 20:04 101 2.83
30 tibom1213m10b Update Low Level Codes and Detect Loops No 07-13-2012 17:13 07-13-2012 20:23 101 3.17
30 tibom1213m10b Update Low Level Codes and Detect Loops No 07-20-2012 17:13 07-20-2012 20:27 101 3.23
30 tibom1213m10b Update Low Level Codes and Detect Loops No 07-27-2012 17:14 07-27-2012 20:41 101 3.45
30 tibom1213m10b Update Low Level Codes and Detect Loops No 08-03-2012 17:14 08-03-2012 20:53 101 3.65
30 tibom1213m10b Update Low Level Codes and Detect Loops No 08-10-2012 17:14 08-10-2012 20:58 101 3.73
30 tibom1213m10b Update Low Level Codes and Detect Loops No 08-17-2012 17:14 08-17-2012 21:11 101 3.95
30 tibom1213m10b Update Low Level Codes and Detect Loops No 08-24-2012 17:13 08-24-2012 21:20 101 4.12

GaryEd
17th October 2012, 22:01
Is there any output from running the session? ie do you actually have a loop in one of your boms?
Maybe someone messed up a bom a couple of weeks ago.

mark_h
17th October 2012, 23:22
Thanks for the response. That was one of the things we looked for - we could not find any loops any place. Tibom1213m000 generates an error report, and I was told that if a part has a loop then the regen run would also generate an error for the part. So we looked, but could not find anything wrong with the data itself. As a matter of fact everything else in this batch job(except calculate cost price) runs pretty consistently. Those two sessions seems to keep creeping up in time.

mark_h
22nd October 2012, 15:25
Well we re-org'ed the three main tables and rebooted the whole environment. Session still runs slow in production. Not sure what else to look at for now.

GaryEd
22nd October 2012, 15:29
Are you running the job with update low level codes set to yes?
What is the performance like if you run it manually?

mark_h
22nd October 2012, 16:08
Yes - runs slow. I have also just learned the 3 main tables are being audited in production, but not in all the test companies. I am leaning towards that - plus the audit flat files are on tier 2 storage making it even slow. I am going to try to get those admins to look at that.

shah_bs
2nd November 2012, 18:54
This was too long ago (1999), but at the time tibom1213m10b used to go into an infinite loop if the session hits a retry point. The suspect was the volume of data because it used to work without failure in the pilot company - in the production company it failed - we had to stop running it for a while till it was fixed.

See if the log files throw up anything - though I do not think there was errors logged since the session was in a loop.

If you have the source code, you could place debug messages to dig out where the issue is - which is what I had to do. Otherwise you may have to get a fix from BAAN - in fact they may require to actually debug with the real data - like I said - it works just fine in a test environment with low volume data.

The main modification I had to do was to apply suitable retry points and change the way the Item Master is updated.

Unfortunately, I cannot post the code for obvious reasons.

mark_h
4th November 2012, 12:54
Appreciate the thought - but since we do not own source code I could not use it anyway. No includes, etc. In our case it does not appear to loop and I am still waiting for an admin to try something around the auditing. They are also talking about moving the application to tier1 storage, but no word on when.

mark_h
3rd December 2012, 18:29
Just thought I would let everyone know it was the Auditing on the tables that caused the issue. The audit log for tibom010 went back to .001 this past weekend and the runtime dropped to 36 minutes.