SPREADSHEET VALIDATION
Regulatory ExpectationsSpreadsheet validation is an often neglected task and one that attracts the attention of all regulators, simply because they are pretty certain that they will find problems in the use, or design, or in the actual spreadsheet validation. Regulators expect you to be able to demonstrate that your spreadsheets are functioning correctly and consistently produce accurate data. If you cannot show with documented test evidence that this is the case, then your regulators or auditors can stop you using your spreadsheets or worse still stop your operations until the situation is resolved. Validation Online offer a complete suite of spreadsheet validation documents, from the Validation Plan (VP) to the User Requirements Specification (URS) to the Validation Risk Assessment (VRA) and culminating in a combined Installation / Qualification / Performance Qualification (CSQ) protocol. These documents are newly and specifically designed not only to qualify your existing spreadsheets, but to ensure that all your future spreadsheet validations tasks are fully compliant.
Shocking News.The importance and criticality of spreadsheets to the pharmaceutical industry was recently reported on. The report indicated that the results of a survey of twenty three professionals in this multi billion pound industry revealed some extraordinary and at times worrisome problems. 
The Trials & Tribulations of Spreadsheets.In twenty years working within the regulatory compliance side of the drug and device industries, if I was asked to single out the single most abuse process in use throughout these industries, I would have to nominate the design and use of spreadsheets. Why does something as simple as a spreadsheet figure in so many regulatory citations? Good question; and at times a difficult one to answer. When you ask a group of compliance personnel the same question you will be informed that Excel cannot be validated because it does not seal the original copy (of the spreadsheet), allows the original to be modified and has an audit trail that can be disabled. All true, but none of these problems interfere with your ability to validate that the spreadsheet is fit for purpose. They only preclude you from using the spread sheet as a compliant repository for any data that has to be stored in compliance with 21 CFR Part 11 .If the spreadsheet is signed off and dated by the user, their supervisor and QA, it becomes regulatory acceptable data stored in hardcopy, and Part 11 does not apply. Having taken Part 11 out of the great debate; what remains. The same debaters might suggest that Excel will round up calculations, and has limitations as to its mathematical abilities. This also could be true. However it is very much up to the spreadsheet designer (and reviewer) to ensure that if number rounding is allowed; it does not meaningfully affect the accuracy of the spreadsheet calculations. Similarly the same persons must validate that the formula calculation is within the capabilities of the Excel software design. We have just launched our brand new SOP for Spreadsheet Creation to cover these and other known target points that the regulators consistently hone into as soon as they find that spreadsheets are being used. Use this Spreadsheet Creation SOP to ensure that you create spreadsheets that are validatable. Then use our spreadsheet validation pack to validate them. SOP for Spreadsheet Creation. -- $125.00 Spreadsheet Validation Package. (Issue-1) -- $525.00 Out of Control Spreadsheets.Spread sheets are a potential source for the classical disaster. Companies run out of funding. Erroneous quality and efifacy statistics are produced and sometimes even stock levels are totally incorrect. On one audit, where the client stated they had four critical spreadsheets to be validated, their network was searched and 212 spreadsheets were found. One spreadsheet had 62 versions, all of which were active. Want some genuine samples please click on this line. You must be ready for, and expect your regulator or auditor to review the quality, structure, scope and validation of your spreadsheets and review the following procedures and records.
FDA Spreadsheet Comments.a. Nearly all of the spreadsheets in the laboratory showed rounding-off errors and none used the Excel rounding function, when needed to avoid rounding-off discrepancies between the original and check calculations by the second analyst. b. Formulas in the analytical procedures did not follow the Excel equations. c. Conversion factors were not expressed in the analytical procedures. d. The formulas used by the check analyst for manual calculations were not the same as those used in the Excel spreadsheet validation. e. The pre-determined specifications or limits were not shown in the spreadsheets. f. Spreadsheets were not clearly documented. For example, the product declaration was not indicated, replaced by only a number in a cell. g. Units were expressed as numbers without descriptive labels such as mg/mL or mg/g. h. Sample weights were described as sample volume and areas as ratios. i. Spreadsheets did not contain provisions for security and integrity of data. j. Spreadsheet applications were not protected from changes, meaning analysts could freely change labels and formulas. k. Regression analysis was calculated with the y and x axis inverted in the Excel formula, which generated erroneous slope and intercept results. Dissertation for the day.A traveler wandering on an island inhabited entirely by cannibals comes upon a butcher shop. This shop specialized in human brains. The sign in the shop read:
Upon reading the sign, the traveler noted, "My, those spreadsheet developer brains must be quite tasty!" The butcher replied, "Are you kidding? Do you have any idea how many spreadsheet developers you have to kill to get a pound of brains?" |
