The quantity of data in the JD Edwards system was growing and performance was starting to decline.
Karen Riner, Systems Administrator at Tyndale originally saw Purge-it! at JD Edwards INFOCUS.
“I was particularly impressed by how the JDE archiving tool was developed and built as part of the JDE ERP system.”
J.F. Shea
How J.F. Shea used Purge-it! to successfully archive 30 years of Homebuilder data
“The volumes and disparate data we were dealing with at the outset were overwhelming.”
“We chose Purge-it! because it’s built into the E1 toolset. We liked the way we could easily access the archived data."
Klik IT developed and built a Homebuilder archiving solution for J.F. Shea using the Purge-it! Custom Module.
About J.F. Shea
J.F. Shea was started in 1881 when its founder, John Francis Shea, started a plumbing company in Portland, Oregon. The company expanded to become a major player in the heavy construction industry and participated in 3 of the country’s top 10 construction and engineering achievements of the 20th century – the Hoover Dam, the Golden Gate Bridge and the Interstate Highway System. The company went on to further include industries from heavy construction to commercial real estate and homebuilding, making it one of the largest privately held construction companies in the nation.
Shea Homes is one of the top Homebuilders in the nation with over 105,000 units delivered since 1968 and averaging 3,000 units annually.
Due to the growth of the company over the last 30 years, the company has generated and accumulated vast quantities of Homebuilder data in JD Edwards.
J.F. Shea began using a World version of JD Edwards in 1990 which included a new Homebuilder module.
The company is currently on JD Edwards EnterpriseOne 9.2 and uses 6 Purge-it! modules: Accounts Payable, Accounts Receivable, Custom Module, Custom Module Extension pack, General Ledger, Purchasing.
Background
Shortly after J.F. Shea implemented JDE World, it was decided that each division would have its own instance of JDE, resulting in 9 separate JDE environments.
In 1998, J.F. Shea purchased another Homebuilder who was also using JDE Homebuilder and consolidated their data into the existing environments.
In 2006, to prepare for upgrading to E1, J.F. Shea embarked on a project to consolidate all the JDE environments into 1 instance and create data consistency going forward.
For some years, J.F. Shea had been looking for an end-to-end archiving solution that could tackle all their JD Edwards data.
Selecting the right solution
- J.F. Shea arranged discovery demos by 3 third party organizations who work in the JD Edwards data archiving space. The J.F. Shea team benchmarked each of the archiving products against an agreed set of criteria.
- The company ruled out the archiving products that required a separate server due to possible increased complexity. Products built in RPG code were also excluded as they seemed much less flexible. Flexibility and ease of use were amongst the key selection criteria.
- Purge-it! was selected because it is built into the E1 toolset and archived data can be easily accessed by users.
Getting started
The first step was to determine a Data Retention Policy which would provide the guidelines for both Archiving and Purging of data. J.F. Shea’s IT department sought guidance from the business on developing a company Data Retention Policy. Further clarification was taken, by the business, from legal experts.
Considering the guidance and the fact that new homes are commonly covered by a 10-year builders’ warranty, it was decided that the data would be kept for 14 years from the community close out date. It was agreed upon that Communities closed over 5 years would be moved out of the production environment and into an Archive environment.
The project began with a series of meetings between J.F. Shea and Klik IT, with the clear aim of understanding, in detail, how the Homebuilder software was used by J.F. Shea. Following these meetings, a detailed data analysis exercise was carried out on the 30 years of Homebuilder data J.F. Shea had in their system.
Safety net for mistakes
Out of the thousands of Communities that were moved to the archive database, 10 - 15 Communities had to be moved back into Production.
In a scenario where too much data is moved into the archive, it is simple and fast to reverse. The data is returned to its original location in a matter of minutes, using the easy reversal functionality that is standard in the Purge-it! software.
Additional re-usable Custom Module schedules have been created for J.F. Shea to be able to reverse data from either the archive or purge databases.
Incorporating automation into the plan
Three schedules have been created to run annually. These will be added to the Job Scheduler in Purge-it!
- Schedule 1 deletes all data in the purge database
(The Data Retention Policy states that this applies to data that has been in the purge database for 12 months) - Schedule 2 moves data, that is more than 14 years old, from the archive database to the purge database (where it will remain for 12 months)
- Schedule 3 archives data from production, that is more than 5 years old, into the archive database.
Results and timescales
The JD Edwards Users in J.F. Shea have experienced a 30% improvement in overall system performance from archiving the Homebuilder data.
The company has recorded a 90% reduction in the quantity of data in the Community Master F44H101 records from a starting point of 3244 records down to 335 records.
Next steps for J.F. Shea
The mountain of Homebuilder data has been successfully moved. Next, the plan is to tackle the data in the four other Purge-it! modules: Purchase Orders, Accounts Payable, General Ledger, and Accounts Receivable for Shea Homes and the rest of J.F. Shea’s lines of businesses.
Story Snapshot...
“Overall, we found the solution to be uncomplicated both in terms of its ability to get the job done but also the dashboard interface that allows for straightforward viewing and monitoring of progress and developments across the JD Edwards environment.”
Genni White, Applications Development Manager, J.F. Shea, Inc.
Results and timescales
“This didn’t happen overnight, but the important point is we got it right!”
The project took three months from the first meeting through to completion of the Homebuilder archiving.
12 weeks may seem a long time, but, during this time, J. F. Shea has taken a huge number of challenging decisions around categorizing data, data retention and archiving.
Notwithstanding that, the company has scoped out an entirely new Homebuilder archiving solution with Purge-it! Custom Module.
J.F. Shea now has a JD Edwards Homebuilder archiving solution that delivers against business requirements and maintains data integrity.
Addressing concerns
“Our only reservation was with Klik IT’s location in the UK and J.F. Shea being in California.
We’ve had no issues at all. Honestly, it works to our benefit! While we are sleeping, the Klik IT team is working."
"We’ve found them to be very accommodating at every step of the project.”
A customized solution
Klik IT has written an application that allows the individuals at Community level to decide what to archive.
There is pre-determined criteria and warning messages will be displayed so that users are prompted to confirm archiving requests. This puts the decision in the hands of the business at Community level.
Next steps for J.F. Shea
Genni White, Applications Development Manager, J.F. Shea, Inc.
“We had to sort the Homebuilder data first before we could get to Purchasing.”
“We’re very happy to have reached this point with the data – we’re thankful for all of Klik IT’s help and enthusiasm.”
