CorpusRecord 145456

2024-12-16 Board of Education's Audit Committee

A searchable transcript preserved as part of the Discourse Corpus. Passage numbers provide stable references within this record; verify quotations against the original recording when available.

Source
YouTube / PPS Board of Education
Date
2024-12-17
Location
Multnomah County, OR
Material
Transcript
Extent
13,533 words · about 76 min
Collected
2026-06-21

Transcript

Verbatim source text

001it's now 533 let's call this meeting to order um right this uh calling to order the audit committee meeting thanks for coming to tonight uh director Sullivan is the chair of this committee but uh since she is out of town I'm her substitute um I guess let's get started with introductions should we go around the horn start on this side for the first time director B Edwards right Eddie Wong board chair uh Committee Member of this committee Andrew Scott board member excuse Sharon coun car Bradshaw executive assistant uh Dan Miley um partner with t and Warwick the district's independent external auditor good evening my name is me Lee and I'm the interim Chief Financial Officer did you want yeah yeah let's go online too uh director solvin you want to say hi you're on mute

002yeah I I see everyone else online nodding so assume they can hear but we can't hear um yeah sorry wait we're we're still I think trying to figure out the audio on this side their is yeah can you try that again okay can you hear me now yes thank you okay great Edie Solomon thank you Edie for taking over and then we have Caroline zavid kovsky hi Caroline zav kovsky I'm a Community member on this committee and Claire Herz hello my name is Claire Herz and I contracted Financial leadership for Portland Public Schools great awesome thank you and I believe we may have two students do we today okay all right let's get started uh we have excuse me um uh chair Wong um I would also like to introduce um Angie Peterman who's also

003contracted Financial leadership you're on mute okay maybe now you can hear me yes thank you okay all right anyway oh hello Walker says we're going off camera thank you great thank you um first on our agenda tonight is a presentation from our external Auditors on the audit results of the fiscal year 2024 annual comprehensive financial report commonly referred to as the AER acfr the external AUD will also be providing the results of their audit of the district's Federal grant compliance in their report on requirements for federal Awards and on the compliance and their report on the internal controls over financial reporting based on an audit of the financial statement performed in accordance with the Oregon state regulations uh mang would uh mang Le would you like to introduce our dark Cal ERS um I think

004we're scheduled for two hours total I haven't decided you have a recommendation do not yeah I think that's reasonable y yeah I was just asking what the um allocation of time for this was versus the bond audit section yeah I think one third of the meeting sounds reasonable or less um any objections all right let's move on would you like to start your presentation thank you very much Cher Wong um you know as introduced this is Dan Miley the partner from talet carala and Warwick who has completed their work on our annual financial statements and U Mr Miley has prepared a brief presentation which I believe he will go through momentarily and just on by way of U introduction we're really pleased that we have returned to our uh routine of having clean audits we

005had one finding in the 2223 audit which was unusual for for PPS and we are pleased to go back to um to having no findings in this year's audit and Mr Miley will go through some of the uh the work that he and his team have done and uh also want to thank Miss Herz and um Miss Peter as well as Melissa eninger and a significant number of Staff in the finance department for for the hard work that's gone into this um this item before you tonight and uh also for the special meeting tomorrow night so with that Mr Miley please take it away thank you um okay so the audit was uh performed underneath generally accepted um auditing standards in the United States of America and then also government auditing standards um a little

006bit different but a little bit more robust than you're generally accepted um the goo um in the yellow book prescribes some additional steps that we need to take um the audit um took place over a number of months interim work was in May um final field work began in October um as part of the financial statement audit as already was mentioned we also conducted a single audit which is an audit over the federal expenditures that the district had um the district had about 109 million of federal expenditures as part of the single audit we selected four major programs um that account for about 52% of federal expenditures um all this work um came down to just a few pieces of paper in your in your Acer um the first one is the independent audit report

007um which we are pleased to um say is an unmodified opinion so this is that the financial statements are presented um fairly in accordance with uh us generally accepted accounting principles also known as Gap um in addition to the single audit and the financial statement audit there are certain procedures that organ regulations require us to do um also known as organ minimum standards um this includes procedures over budget procurement one of the procedures is over um ADM and with in that there's procedures that they ask us to do over teacher experience reported to um OD the Oregon Department of Education um while performing that testing we did note four of the 60 teachers that we selected um for testing the district's record did not support the amount um reported to OD um and this could

008be for a variety of reasons um through um just different thing different information was available at different times um the single audit um includes um what we call the gas report this is the um report on internal control over financial reporting um no material weaknesses or significant deficiencies were noted and then um the report required by un guidance so this is the actual report on those four major programs um is an unmodified opinion so we um found that the district was in substantial compliance with uniform guidance as Rel testing um the district um implemented gasby 100 um which provided some consistency among different governments um for for changes in error Corrections mainly disclosures this did not have a significant impact on the district this um year one other minor change that the district did that

009isn't really with um accounting per se but they included the schedule of federal expenditures within the act for this year and in the past they have kept those separate so that's why there may be a few extra pages that weren't there before um they combined two separate reports um there's some significant accounting estimates that we encourage all those in charge with governance the board the audit committee to um pay attention to estimates are one of those places that management can assert bias um they require judgment and that's why they're an estimate so some of these include fair value for Investments um shelf uh Self insurance claims and of course OPB and pension Rel balances and a few others that are up there um we're not we weren't aware of any uncorrected misstatements and we proposed

010no audit adjustments um during our audit um there was some adjustments but not as a result of audit procedures there we weren't aware of any consultations with any other accountants um looking for other opinions that kind of thing um to be aware of coming forward um there's four statements that gby has issued that the district should be implementing over the next couple years uh gby statement 101 um which is compensated absences this will add additional or potentially add additional liabilities to the district's um financial statements um traditionally it's been what's been paid out that's the liability that's been recorded now it will be paid out or used the biggest area that that will impact is sick leave before that since that was never paid out that never showed up at least within a financial statement

011number um now the district will have to estimate how much of that will be used and record that estimate there um I like to say that reality has changed this isn't a new liability you guys were always going to give people sick leave and that kind of stuff um just how we accounted for it changed um the the next one gby 102 this is uh disclosures about risks um the common example for for this is U may not as be a per to the to this District but think of a small rural School District the largest taxpayer goes out of um business that's a huge tax hit to the tax base that would be something that would now be required to be disclosed so anything that would have a significant impact on the district's finances

012would now require disclosure underneath this new gby um looking two years in the in the future there's some changes to the financial reporting Mo model um various improvements and I have details in the letter that um um was sent with the ACT for's report and then also there's some changes to disclosures around Capital assets also coming um both 103 and 104 are two years out um we also like to take this opportunity to remind everybody that there's a shared responsibility for Independence we take Independence very seriously we all do what we need to do to maintain our independence but some of that is also making sure that we don't stumble into something that may impair our independence um and then also you've been provided a management representation letter these are a list of I think

013about nine pages of items that management has represented to us and that was included in the communications to those charge governance letter as well so that sort of ands sort of the prepared of our piece of the puzzle of the different reports that are in there um happy to answer any questions that you may have thank you for the presentation is there any um board disc discussions or questions start with a couple questions and let others um join in um first of all congratulations to the district team for a clean audit uh it's always good news and um I do want to note that we just got the final this weekend it's 10 and some 20 something Pages not including the single audit um so I I don't feel like I've had a chance to

014thoroughly go through it I did read through it last night um but I just want to note for the for the record um I I don't feel like we should be um um voting on on accepting it tomorrow night um I have it's a just a I'm trying to reconcile some of the discussions that we had last year during bargaining um about our finances so it was an um it was a much discussed topic but if I'm looking at page there's a um commentary on net revenue and net expenses and and um on page 22 and 24 and it has our Revenue up 6.5% which is 73 million and our expenses at 4.8 which is a 47 million um which showed that our Revenue increases um outpaced our expense increases and so I'm I'm curious

015because there was a lot of disc discussion about how we'd be making a I'm assuming this is this is general fund and the special Revenue funds that this that we'd be making reductions because of our expenses this year when it doesn't look like that's what happened if you look at page 22 it says revenues for the fiscal year an increase of 73 million in the Pages later it has our expenses at 47 increasing by 47 million so our Revenue outpacing actually our expenses thank you director brim Edwards uh I'm hoping Miss Peterman and Miss Herz are are uh hearing the question as well uh I believe I believe those statistics are from government wide the government wide table rather than just the general fund and special revenues so therefore including Capital funds Miss Peterman or

016Miss Herz we it would includeed as um Capital funds would be considered Revenue it's operating grants contribution revenues let's it has Capital grants as a separate item it's on page right Angie are you able to miss Peterman are you able to clarify or address the question that director brim Edwards is asking um yes I need just a minute I didn't have uh that specific page up so I want to make sure that I'm on the correct page if you give me just a minute okay very well this is this is from um from the mdna the management discussion and Analysis it's the summary it's the The Narrative describing the the major total changes in revenues versus expenditures uh and it's as director brim Edward says it's on uh I think it's referring to the table

017on page 22 of the act for document and there's language at the bottom of page 22 and on the top of page 24 so director brim Edwards if we can uh Circle back to that after okay I mean it looks like from the table that it's property taxes local option construction excise tax state school fund common School fund investment earnings that totals the the 73 million increase in revenues so you can Circle back and maybe a secondary question I'll just put out there because it may also umire there there is um on page 22 also it says there was um a 27 million um dollar from the prior year due to improved interest rates and investment of bond proceeds related to capital projects um so the interest rates um if you're if you have money

018that's sitting there you're getting um interest on it it's been a couple good years um versus Pay paying the interest is that generally that's not going back in is that going back into the to the capital budget or is that going do we have that available as like one time only um operating the the interest that's generated from the capital for the most part Bond uh accounts remains in those respective accounts rather than flowing or accruing to the general fund or or other funds so this 27 million would be added into the 2020 bond funds uh I I believe that is largely the case I I think there might be some smaller amounts that remain much much smaller amounts that remained U unspent Mr Young is here as well uh from the I believe the

0192017 uh Bond account so the respective share they're each uh established in their own respective accounts and so to the extent there are balances that are generating interest um on on any of them they would remain within their respective accounts but yes I believe you're right the 2020 uh the 2020 Bond uh accounts would have the bulk of the the construction uh and then on project so correlated to that maybe this is a question also for when we talk about the bond is that on page 18 it says on June 30th uh 2024 the 2017 Bond still had a balance of $98 million comprised of investment earnings on bond proceeds which is the first time I've heard it there's that amount of money left over and ironically I'm not sure if it's left over because

020we were over a 100 million short on that right so I know Miss Peterman has looked at uh that the the uh information in that paragraph as well as the table on the bottom of page 18 very closely we we had a back and forth on on that uh information as well so this Peterman if you can also address uh that question from director brim Edwards about the remaining balance in the 2017 Bond authorization of $98 million of course that would be helpful Sor my grandson's decided to get cranky and dad didn't get home yet so my apologies I've got a little extra background noise um so we from the uh 2012 2017 and 2020 bonds we're tracking the dispersement of bonds which happen which happens um within the time frame that you know we're

021allowed in which to spend the bond proceeds and at the same time those funds are being invested and we're generating substantial interest revenue from them so um excuse me what we um determined is by going through and looking at the dispersement of bond proceeds first and then ultimately the investment earnings at this particular point in time by June 30th of 2024 we still had 98.1 million the 2017 bond fund and that consists of investment earnings over the history and life of the bond Pro Com come in and dispers I'm really sorry don't worry at all I um have three kids and I've been in that position um I don't even hear it frankly so I just don't worry about that um so so in terms of the um outstanding expenditures that are expected that would

022be something that we probably need our chief operations officer Dan young to um comment on that so we don't have necessarily the detail in in the financial report of what that's being spent on but that's more covered by the bond program itself and just to be I guess maybe this is a question thank you and this is a question maybe for the auditor so when you finished your audit there were $98 million sitting in the whatever fund it was for the 2017 bond in the subf fund um because there's funds tracking all this that was the fund balance for that fund okay and what happened to it that's not an auditing question that's a Dan question okay so I um I'll be be interested in that um but I guess thank you for establishing that

023we have 98 million doll because that's um good to know uh and then I guess as a follow on it would be good to know from the improved interest rates this 20s something million that was um generated it sounds like it might have been across several uh bonds and I don't know if this is a followup young for for you and your team to know where those get where those got distributed too sorry director B could you could you repeat the last part that so in when I ask a question about where the there's a statement at the bottom of page 22 that um investment revenues increased 27 million from the prior year due to improved interest rates in the investment of bond proceeds related to capital projects and I thought what I heard the

024answer is is that spread over some other bonds and and so I'd be interested in what sub funds those are sitting sitting in this is referring to when you say Subs justor yeah so the district creates for budgeting and tracking purposes is what I call sub funds so they aren't reported separately um so there's a handful of capital projects funds one for each Bond um one for Grants um one for um relocation of a school those types of activities those are since they all relate to capital projects and but they're all tracked separately they all get more or less combined for reporting purposes um as part of our procedures we did look at some of the investment um earnings the track and it is tracked by the district Investments by each one of those funds

025and those investment earnings are then deposited or recorded in those individual funds so like the Harriet Tubman 120 million from the state that's sitting there that gets all rolled up that's part the increase would be part of the $27 million but it still remains in its respective segregated account great and this is just a u more of a technical um question when you put together the budget are you allocating those investment dollars I'm trying to remember seeing that as a account it's just just in the past years it probably hasn't been a big thing because the dollars weren't very much but right so with with the general fund portion of the investment returns that which there is a a a portion of I think in the table it says $56 million 56.2 million in F

026in the fiscal year that's the subject of this audit uh was to in total generated from thank you uh from investment returns so I believe the the figure this is from memory was about $10 million of that represented the general fund portion of investment returns so in terms of recording those revenues those are all general fund revenues there there there isn't a specific set of expenditures that's associated with with those those particular revenues that they are an important part and helpful part of our total revenue po although they could be considered one time they fluctuate yeah better it fluctuates based on interest rates so for right now I guess my last just if is there an answer yet on the $73 million in Revenue increase in the 47 this Peter do you uh do you

027have any comments at the moment about the those the original question the first question that director brim Edwards asked or let us know if you want us to restate the question um I apologize but I'm gonna need about two more minutes I don't know if you want to move on and then come back um but I haven't been able to pull information my grandson's been less than Cooperative but dad's home now so and I guess I'll I'll just also add in the other question is like we cut um 30 million last year in the budget mang and 40 we're GNA be reducing it by 40 this year correct so those are general fund figures for 2425 and 2526 respectively so when I look at the the numbers on page 22 I'm trying to see where

028the because it looks like um actually expenses increased is it because they increased in some categories and decreased I'm not seeing it is that what happened I I think the The Challenge and and uh looking at this table is that it's much broader than than just the general fund so the general fund is contained it's it's those are those dollars revenues and expenses fund balances and the like are included in the numbers in on page 22 on that table and in the ACC company narrative but there are additional funds that are also included in those totals so if we had a a version of this table that was exclusively focused on the general fund then it would be easier to uh to to do the type of comparisons that I think you're you're contemplating um

029with respect to the 30 million and the 40 million for example just to illustrate the the structural imbalance that we have in the in our general fund between revenues and expenses I mean the one place where you can see that there's a ction is the Enterprise and Community Services what funds or services are in that bucket uh Enterprise and community services so that is a that is a aggregation of of function codes if you give us a minute I'll go back and look to see what some of the the larger items are in that category director solvin do you have any questions regarding this item um that item no but I have a question um if we want to wait there was something I noticed when I was reading it it said the audity is

030audity qualified as lowrisk audity and it was no so does that mean we're a high risk audity or is that just language I don't know what it means so if I may um part of single audit is you have to qualifi you have to determine whether an audity is low risk or high risk one of the things that will move you from a low risk to high risk is if you've had a material weakness in the past two years last year because of the finding last year the district will be a high-risk audity for single audit purposes for at least one more year okay and then hopefully no more findings we could return back to being treated as a lowrisk aity um the main difference there's some subtleties but the biggest impact to the audit

031is the percentage of coverage that we need of the of the federal expenditures 20% versus 40% historically meeting either one of those thresholds has not been an issue especially with the amount of uh education stabilization funds that the district has been having and us having to audit those so you just check us a little more carefully for a couple of years yep okay thank you and regarding your question director Ben Edwards about the the category of Enterprise and community services so those the bulk of those expenditures perhaps all of them um have to do with our student nutrition program so in the Statewide chart of accounts that category appears to be focused in PBS's case at least on Food Services um so I think that that would include largely our our student nutrition program because

032we have fewer students we get a we have a reduction perhaps I I I don't I can't say uh that I have firsthand knowledge uh at the at the moment about what's what's behind that 2.9% reduction but that would that would make sense okay thank you Scott thank you um first thank you for the work on the audit and glad to see that there are no material weaknesses or other findings that's good um you did mention the teacher experience and just um remind me that's shown up in Prior audits as well and sort of a systemic issue and I yes yeah and and the district is not alone that was going to be my follow I think I asked this last year other districts struggle with the same thing is is that accurate and and

033looking into it sometimes OD will go and change a number based on some other District's reporting I so there's just a number of moving Parts in this um ideally when you hire somebody you get all the information sometimes the other District that they were at doesn't respond or the respond in time for the reporting sometimes you update it we're also looking all a year behind so because the state school funds are based off of last year's numbers what you got this year um so there's just a lot of moving Parts into it um and so it's one of the areas for school districts anyways it's not an uncommon finding is this a uniquely Oregon accounting issue yes that's uh okay thanks on that um then two that was all my questions two comments I would

034just I would I would caution both the board and the public from um trying to read too much into the financial statements around the uh District's budget or forecast those are those are different things they are crossw walkable if that's a term but with with some difficulty I mean the numbers are the same and you can show them but financial statements are not intended to be budget statements and budget statements are not intended to be financial statements so yeah we actually prepare what we call a gby 34 crosswalk to get from the modified acral basis which is your budgetary basis for the most part to the full cruel basis which is your entity white statements right right so um and the reason I raise it from the public as well as I mean I think

035we saw some of that during during during our strike right some of the folks going to our financial statements and saying oh my gosh you've got all this money and we were saying well we don't and they're saying well you got to prove to us that you don't and so I just they they they really do serve different purposes and so I just think it's important to keep that in mind and then I'll just say I again not a Committee Member but as a board member um I would I would not be in favor chair of of delaying uh the acceptance of of the act for um you know again I I think we're accepting it um there to the extent there are are questions that come out um those can be asked at any

036time during the year and in fact actually it's probably a good practice for board members to sort of look back to it and and and come up with questions but um I don't think there's anything that we as a board would discover in the financial statements that would keep us or should keep us from accepting the report um moving forward so I would just encourage that we we continue on that schedule so we can wrap up last fiscal year which ended in June 30th and move on to the next one I'm just going to respond to primarily it's just our the fact that we got it over the weekend and we have a set of adopted protocols that we get our documents in advance so that board members have time to review them and we

037didn't meet that measure and there's there's no reason that we have to accept it at tomorrow night's meeting and you know I I do given that I'm on the audit committee I have an opportunity to ask questions all the time but I also think this is part of the agreements we made with staff that will give board members opportunity to R viw documents and it wasn't like it was a five slide PowerPoint um so I just again and as a courtesy to I say I look at this and it's great we have a clean audit and um I think it's better to just follow our normal our normal process which it would be you know having it posted and board members having an opportunity to look through through it um versus turning it around in

038two days yeah I disagree I'll be looking forward to moving it Forward tomorrow that's video yeah I think I I just don't understand your concern because I because an acceptance is accepting it right not an approval or and this kind of work is ongoing and we can keep continue reviewing I think it's good practice that we continue reviewing U and also over previous years um like for example when UPS delivers a package and I have to sign for it I accept accepted but I have no idea what's inside well sometimes I do but um uh so is that I mean like what a part about accepting it's the public transparency of we put our our audit out there I mean we have an opport so for example it's like we have the auditor here tonight

039and so for example if I wanted to ask questions about it I had to read it last night um and our protocols that we adopted as just a courtesy and professional to board members but also to the members of the public who want to look through our audit that we have it posted and that we have adequate time to review it and it's not just like getting a package I mean it's a thing like if it was just accepting it that we wouldn't be why are we voting on it and um so I just think it's better practice and again it's a it's a clean audit so why would we why would we object to having it out there having it long enough that the public could actually look at it well so the public

040can look at it at any time it's transparent it's posted you can look at past audits as well so there's nothing that we don't take it down after tomorrow night's vote so uh board members can look at it the public can look at it it's fully transparent nothing's also going to change unlike other things that we might vote on that board members might want to amend or change that that's actually not a role we have in this case we can't amend our financial statements nor nor should we try to and so for that reason there's actually really no reason and delaying it until early January just delays the completion of our audit it has no actual impact on whether we accept it or not director finish please um so I don't even remember where I

041was um the I think the point being that nothing's going to change around it I think completing um the acceptance of a completing the financial statements and being done this is the end of the process and it is it is a role that boards play to accept it um getting that done before the end of the calendar year I think is also important to me particularly when there's no um there's no value at all in waiting it would be something else if there was some change that we were going to make or some Amendment or some other change that might might happen there with more time but the only thing that's going to happen with more time would be more questions and those questions can be asked should be asked um throughout the entire year

042so it doesn't reduce transparency doesn't reduce our ability to ask questions and otherwise it just unnecessarily delays the process again the board approved a set of protocols that we would be treated in a professional way and get our materials on time we got it this weekend it's 120-some page document and I don't see why we would shove it through but obviously it's it's your call I think it fails the test of like transparency and also sticking to our commitments to each other director suvan yeah I'm I'm not sure but I think it's kind of important this gets done before the first of the year as far as um actually an award I'm not sure I'd have to ask Janice but it it is important to get it done and when I read it it's very

043hard with all the numbers to know exactly what they mean I mean just the one little bit that that uh director brim Edwards asked about you know was was so complicated but I do think it's a wonderful thing to keep looking at because for me when I looked at the early retirement program the compensated absences so many of the things that cost so much money it looked like you know things we could talk about later with policy but that's not something that we need to um to talk about before we approve a financial statement so that's where I am thank you director salvin I also too agree I think we need to move forward I don't think uh accepting it tomorrow or not is going to affect transparency it's a public Document Plus this this

044document is reflection of the work that the Auditors are doing which is in itself the practice of transparency um this is something that we we do need to again continue to um to revisit you know half the board members probably have not even read this document yet um and so and they wouldn't until we accept it so I think that's I don't again I agree I don't think there's any benefit in delaying the acceptance um this is a public document um and the work continues so I do have one request before we kind of move on to the next topic um I noted that it was brought to my attention that um the independent audit 's report on compliance um from like 2018 to 2023 it looks like 2023 report there wasn't any identifi non-compliant

045but the other years there were um would it be possible to request I would like to request that maybe the staff we revisit this in future audit committee meetings to kind of revisit the some of the non-compliances from previous years um just to make sure that there are any holes and also um especially since it may be important to the the state school funding formula so that's there's a request not for now but for for our future meetings director s oh your hand just went down never mind any other last questions before we move on board CH yeah just I just want to say thank you and this is a lot of work um for everybody involved um while we work very closely with management and we appreciate all the assistance that they do we

046do work for the board so we are open to questions whenever you may have them um we we definitely want to make sure that um the board is comfortable in their role of oversight at least what we can do towards that thank you very appreciated a lot um I also see um Angie Peterson correct uh has her hand raised thank you I um just wanted to Circle back around to director brim Edwards um questions and I I do apologize for delay in my ability to be able to um pull it together but um the government-wide statements which um are those that are reflective of the $73 million Revenue increase versus 47 million on expenditure side consists of all of our funds so if in fact you look at Pages 34 and 35 in the audit

047you'll see a breakdown by Major funds so the general fund special Revenue fund so forth the general fund expenditures actually exceeded the revenues in the 2324 fiscal year and you'll see that reflected on that statement so we used some of our um ending fund balance beginning fund balance last year in order to fund all those programs and services the special Revenue funds all those 200 funds on the other hand generated um some additional Revenue predominantly that really had to do with um investment earnings and then um other I think Grant funds that excuse me had not been fully um weren't required to be fully expended um The Debt Service fund and looking at that oh gosh Debt Service fund actually also had expenditures in excess of Revenue and then our capital projects fund um did

048as well when you know we look overall all of those pieces and parts but if you back out I believe The Debt Service component then when you look at um the revenues and the expenditures revenues did climb over 23 I'm sorry over the 23 fiscal year end um faster than revenues did but for the most part it was capital projects and um the 200 funds special Revenue fund where that occurred not in our general fund we did spend more than our Revenue in the general fund that offline conversation but when I'm looking at the on page 22 it has a it doesn't have any of the capital projects so I guess one of the questions and maybe this maybe this for young I'm seeing it it does include the um investment earnings but in our

049we don't count things as one time only it's not maybe not one time but it varies that that's generally always included in our line line item and I'm assuming then we didn't we didn't anticipate that we were gonna have that amount of money when we said that we were going to be making significant Cuts or that our expenses were going to exceed our Revenue with spec with particular respect to investment earnings when when we [Music] were updating our financial projections say 12 to 15 months ago um when we were starting to to look um for a period of three years at the relationship and the trajectory between our fund balance or revenues and expenses in all of that work we we did identify a glimmer of positive news with respect to higher than previously anticipated

050uh revenues from investment earnings so so that that was not a surprise in preparing the financial statements um that are the subject of this audit so so we've known that for for a little while and fortunately those higher levels of investment revenues they have for the most part held up in including for the beginning of this fiscal year the 24 25 fiscal year so so that's been uh that's been part of our set of assumptions for for more than a year um the the 27 million that represents the increase in in all of our funds across all of our funds between the prior fiscal year 2223 and this fiscal year sorry not this the the fiscal year that's a subject of this audit FY 2324 um interest earnings basically investment earnings uh across all funds

051between those two years and I believe and Miss Peterman and Miss Herz please U jump in if if you think I'm remembering this wrong but I believe our general fund interest earnings or investment earnings increased by I think about four or five million between 2223 and and 2324 so so it was a meaningful Improvement but it's a fraction of this million okay great thank you director brim Edwards I also want to clarify page 22 the government-wide statement table that you're referring to I think that does include our capital projects funds as well as general fund as well as the special Revenue funds um excuse me and um so it it does in fact reflect um um those additional investment earnings across all funds as well as um the other revenues such as capital grants um

052that were received during the year thank you thank you all right with that um if there are any objections um unless there are objections I would like to proposed moving the 2024 acfr and the reports the report on requirements for federal Awards to the full board with recommendation from the audit committee uh that the board accept these reports in the the next board meeting which is tomorrow December 17th any objections I I would abstain because I'm objecting to we got the materials so late and it seems like there's no re there's no reason to Russia there's no requirement statutory or policy wise that we need to do it so Youk you you and uh chair Sullivan can move it with your recommendation chair Sullivan um yes I vote I vote that we recommend to accept

053it all right and I also recommend that as well which I just said um great we will be moving this to our um board meeting tomorrow yay thank you to the team ERS at tkw for the incredible amount of work uh and also for chief M and and the PPS Financial team so a lot of work put in this and really appreciate it thank you thank you very much you're welcome to stay if you want where you can go it's a dark gloomy night so no better place to be than here right um all right next on our agenda is a presentation from our external Bond Auditors of the year five audit from our 2017 and 2020 bonds um senior director stormy Shanks is I think up for presenting this right um who was the

054director of school modernization um just really quick a little bit background uh with this citizen accountability and oversight of the annual audit of the bond project is a requirement um then just resp the need for accountability regarding the district's effective use of Capital Construction bond funds the PPS board has appointed a citizant bond accountability committee uh who serve as an advisory committee to the board um thank you I'll I'll go over the rest later but yeah if you would like to present your presentation yes uh thank you good evening I'm stormmy Shanks senior director in the office of school modernization and I'm actually going to introduce you to uh Kathy Brady who's on the um she's joined us virtually to do the formal presentation of our uh year five Bond performance audit okay well um

055good evening chair Wong members of the audit committee uh my name is Kathy Brady and as stormy mentioned I am here I'm going to try to run a PowerPoint virtually so we'll see how that goes um just does everyone see the screen or the presentation yes yes perfect okay I'll try to uh make up a little bit ground I know ground I know it's late um and uh I'm sure everyone wants to get home so just a let's see here a very quick background on our firm shurg event Consulting it's a mouthful we are certified women-owned small business founded 25 years ago by the former California state auditor we work as solely with public sector clients based in Sacramento California but we have several local long-term clients in Oregon and we have significant experience auditing

056school districts Departments of education and Higher Learning institutions in addition to Capital Improvement projects at a variety of different entities and in the different industry sectors um our audit efforts are enhanced by our team of professionals we have certified construction Auditors CPAs and um a lot of other designations to help us with the audit before we get into the details I wanted to refresh quickly the why what and when for these Bond audits why we are here is because ballot language included these annual audits as part of ps's commitment to transparency and accountability to taxpayers what we do is really look at a variety of bond areas related to 2012 2017 and 2020 B uh projects each year the audit focuses on different areas based on sort of the particular phases the vond projects are

057in and as directed and approved by osm when these audits occur is on an annual and continual cycle so it's as the projects and activities are in progress and as Protocols are changing and the benefit is that of that is that the audit can proactively highlight any risk areas or issues so that hopefully changes can be made in real time rather than waiting till after the end as most audits do when a project is over I also just want to provide a refresher and background on the bond audits themselves they started in 2012 they were conducted by a different auditor who issued four reports in 2014 15 16 and 17 and then in 2018 PPS hired our firm Sher gishan Consulting to do the annual audits at that time just for the 2017 Bond program

058it subsequently was expanded uh when you passed another successfully passed another 2020 Bond so we look at those as well all our audits follow generally accepted government auditing standards gagas um and as you know from being on the audit committee those standards are important they provide a framework that allows for that accountability through the requirements that Auditors must follow um and they set expectations that we will follow those structured steps on Audits and then the users can rely on our results I was going to go into them all but you probably know a lot about them there's standards that talk about the characteristics Auditors must have um and follow fieldwork really that we need to have sufficient evidence and appropriate evidence to support what we put in our reports and then finally the report has

059to consider the views and incorporate those views of responsible officials um in terms of setting the annual audit scopes for each cycle like I mentioned we try to align the focus areas with what's going on with the bond at that time whether it's in construction or design since audit resources can't cover every area each cycle and and limited depth um but a few months before the the audit begins we propose a variety of audit areas to osm who by the contract uh reviews and directs the areas to be reviewed um let's see we have done several past audits before the year five which we'll talk about tonight um some prior audit Scopes I'll just highlight here um year one we looked at the 2017 cost estimates like models assumptions cost factors but we also looked

060at the planning practices financial management project management and sort of the project delivery framework that was in place um while the the bond was getting set up for year two we focused on the delivery status of health and safety programs in addition of the modernizations uh we looked at Contracting and procurement practices um construction management practices and um found that generally there was good practices in place that aligned with leading industry practices although we had um several recommendations for improvement moving on to the next audit Cycles in year three osm asked us primarily to focus on the first of three Equity programs that year we looked at business equity and as well to focus on bond Communications um we also look at every every cycle we look at the status of the bond projects and

061we follow up on audit recommendations uh year four uh we focused on Project closeout there was Project the some of the schools were getting done we looked at the second um arm of equity the contractor Workforce Equity we looked at project performance and we looked at a high Lev review of the 2020 bond that was just coming out at that time just looking to see if there was a framework in place to ensure that there was consistent progress and delivery on those Bond projects okay so that brings us to the year five audit as you can see on this slide we focused on about five main areas the bond delivery status for the 2017 and 2020 bonds the third and final um area of equity career learning Equity we looked at program delivery of care

062curriculum program delivery of technology and then we did our followup of Prior recommendations so let's get into the details in the first report section we provide results on the overall Bond program status and progress made at the time of the audit um you know this was done a year or so ago um the two remaining 2017 modernization projects and Lincoln and Benson were on track for plan completion at that time we found Lincoln was budget with an estimated Savings of 9 million to 9.5 million but at that time no decisions had been made yet on the use of those savings or how it might possibly be reallocated to other projects in terms of Benson estimated cost at completion had continued to increase um but at that time they were anticipated to be covered by the

0632020 Bond so the risk remain that cost could continue to grow though and bond contingency would start to get stretched then we also saw that the health and safety projects that PPS um was implementing were on Target and they were planning to complete scope by the fall of 2024 we also looked in this section at the status of the 2020 Bond program which had similar elements to the 2017 Bond but they also had some new Bond categories related to curriculum technology capacity and a center for black student Excellence um during the year five audit we found that at that time the 2020 Bond was mostly progressing as planned there were some issues with um uh cost schedule and scope challenges but there was fortunately a large contingency available to cover some of those overages for

064instance Jefferson's cost estimates grew significantly increased about 55 million due to inflation the construction Market um estimates grew 16 to 20% higher than the original estimates in 2020 when they went Jefferson started in 2022 and they saw that those estimates were higher the audit looks at okay you know what's going on with that is that reasonable so we looked at thirdparty estimates and found that really you know those those estimates are what was coming in at the market at that time and again program contingency was allocated to cover Jefferson cost increases at the time we also Al looked at the physical improvements similar to the health and safety from the 2017 bomb physical improvements were on target um except for mechanical and Roofing projects that face delivery challenges for mechanical although the bond itself didn't

065identify which improvements would be made at Wet schools PPS planed to do uh repairs after the bond pass at about 15 of the highest priority sites um similar to the other projects the mechanical estimate costs um also grew significantly between 2020 and 2022 so PPS chose to provide different improvements instead of full system Replacements at just a handful of schools PS chose to do system control upgrades and component Replacements across more school sites um likewise roof projects was another area that experienced higher than expected costs not as great a cost uh increased maybe about $5 million again these were covered by program contingency so um for us even though they may not have it delivered as they internally had planned again not promised in the bomb but what their internal plans were to do with

066that Bond money for that investment in the mechanical and roof categories the the physical improvements that they had still aligned with the 2020 Bond intent um for the capacity um program um about 10 million was set aside for improvements um again the bond did not specify what specifical Capital Improvements or unique sites were going to receive those um one of the sites subsequently selected for capacity improvements was a high-risk school um Harrison Park Middle School um but they found that there was significant scope increases that resulted in higher costs than expected sort of a lot of higher costs than expected theme here um for Harrison Park there was like initial allocations of 4 million of that 10 million and skyrocketed to about 42 million mainly because additional work that was needed to meet some middle

067middle school education specs and some of the issues that were just um residing there at Harrison Park um to cover those e excess costs PPS allocated from some of the other Bond categories the mechanical security and Technology because Harrison was identified as going to receive some of those upgrades to so they sort of compiled it all together to get the plannned um capacity improvements at Harrison and um the rest of the money came from the bond contingency fund which was fortunately um large enough to come some of the increases the 2020 Bond also set aside 60 million for the center for black student Excellence or cbse um at the time of the audit in 2023 no money had been spent and it was two years behind scheduled from Baseline plans um PPS had certainly engaged

068the community the cbsc community and program design um but these efforts had not progressed to the point where something was detailed on what capital Improvement would be made where that Capital Improvement would occur and when it would be implemented um that Community engagement took longer than planned and the risk is that um from our perspective that cbsc will not be delivered on schedule or as intended um lastly there was also some Bond money for planning and design of Cleveland and ID Wells and at the the time of the year five audit efforts were on schedule and Budget moving to um the second section of the report the career learning Equity It's the final um Equity area that we looked at that had an objective to expand the number of young people of color and young

069people participating in a variety of career learning programs to implement that program PPS um executive leadership issued an administrative director directive excuse me that highlighted four main responsibilities register contractors and offer learning opportunities coordinate with contractors and conduct learning activities manage track and report on contractor and student participation and develop processes to expand the program to middle school yet the audit found that PPS had not established or implemented a structured program to meet those responsibilities and we could not determine where the ultimate equity objec were met specifically there was no structure in place to assign or delegate specific roles or responsibilities and that led to uncertainty on who was responsible for what um there was insufficient protocols really unclear procedures and that caused Summit in action on key responsibilities some of the um data and

070Reporting duties were assigned Loosely to the Career and Technical education staff in Partnership with procurement and Contracting but many of the critical program functions um weren't assigned out or weren't being done related to contract management and compliance program coordination and really Data Tracking and management we did find some career learning examples that were occurring um we for instance we found a woman owned architectural firm provided five we internships for students and a general contractor provided construction management classes in another instance but because there are no targets or measurements of outcomes no meaningful data captured PPS can't determine whether it's meeting that Equity objective as such we made two recommendations in this area the first was for PPS to research and assign the resources needed to implement a structured program with all the elements that we

071mentioned that were missing or if that wasn't the path that PPS wanted to take it could alternately revise administrative dire to limit the scope of the program to more appropriate line with the district's capacity uh two other areas that we looked at in terms of program delivery were curriculum and Technology um for several decades PPS reported the need for tech technology upgrades and new curriculum that have been out of compliance with OD standards for some time and um while the language in the the bond itself didn't promise specific quantities of improvements or name specific sites where curriculum and Technology improvements would occur PPS planned a variety of activities to meet those um the needs using the bond funds starting first with curriculum they're combined in the report because the um sort of results are similar

072but we'll talk about them separately so overall we found that uh PPS is office of technology and learning OTL how to establish a good foundation to help manage and monitor curriculum bond funds there were established roles and responsibilities documented analysis for decision making and tools and systems in place to monitor the funds and oversee delivery um we also found that OTL had um established procedures and protocols to keep users aware and the end users aware of the improvements plan and they work closely with the teachers it's part of curriculum selection and and allowing the Educators to be familiar with the materials before teaching the curriculum in terms of delivery of the projects um the curriculum timeline aligned with Baseline schedule and we didn't find any major delays however the spending did need some additional funding

073um as of February 2023 OTL had spent about 71% of the allotted bond funds and expected to spend them all um by the the fall of 2024 there was an additional 14 million of General funds needed to pay for some non-compensable expenses that were related to cost of the curriculum some professional develop development for teachers and some student field test materials among other items um we also looked at performance metrics to see okay we we've spent some money on these things um how do you measure how successful they've been um and specific outcome measures looking at the before and after the curriculum improvements had not yet occurred at the time of the audit but OTL had planned to measure some of that Success Through standardized test scores and some electronic material utilization in the future

074moving on to technology we found much of the same um just like curriculum technology had a structure in place to guide delivery they had establish a framework that applied documented analysis driven methodologies to make delivery decisions um that best prioritize the school needs they they're based on um solid factors Quant quantifiable factors building schematics um existing infrastructure historically underserved communities and other factors that help them prioritize school by need um while again while the bond didn't plan or promise specific quantities of purchases or specific improvements to be made at certain School sites um OT Otis excuse me um detailed the types of Technologies is intended to deliver and we found that those improvements were generally progressing as planned um there were some schedules in scope impacted in addition to some non-compensable items that um expenditures

075that were needed coverage from the general fund as well um much of it much of the delay really um related to some planned whiteboards that were to be sure everyone's heard about it you know to be wall mounted over existing boards then the design change a little bit about maybe we just move remove the existing boards and put the whiteboards on there but that um removal would have required some abatement of hazardous material which would increase the budget in addition to having hasard this material out there um and delay the SK schedule even more so ultimately PPS chose um a different solution to implement and address the need to install some ceiling mounted ejectors with cool down screens to help mitigate the cost so the cost was okay but then it did delay the um

076scheduled delivery about a year so the audit you know when we're looking at from an audit perspective the scope differed from their internal um original plans but the alternative still aligned with the intent of the bond improvements um we looked at the cost and as of May 2023 Otis had spent about half of its f fund which was generally conasur with a delivery progress about three years into a five-year delivery um there was um documented progress made with purchases of about 880,000 individual devices 95% of those were made available to students um but as I had mentioned there was about 11 million in um technology expenses that were deemed non-compensable um mostly related to some planning for PPS and prise resource planning system replacement and so the general fund was used to cover those costs

077we looked at performance for technology as well um and those performance measurement efforts are still in progress at the time of that audit um and measuring success of Technology improvements can be challenging um but that set metrics that Odis is considering was um to be put in place was looking at outputs such as counts of desktops laptops and monitors installed um as well as looking at some performance like bandwidth performance and Inter internet speed um we saw some data that um Otis had reported internet speed had improved and that total time loss from Network outages was reduced by 31% in that first year so overall for curriculum and Technology um at the time of the year five audit the commitments were generally being delivered according to plan and in line with BL Bond pledges so

078we had no recommendations in that area um moving on um this is our prior audit work it's in appendix a of the um audit report sometimes it's a separate chapter in there um but what we found is at the time you know osm definitely reiterated its commitment to addressing the recommendations but there was no evidence of progress made since the prior audit that we had done in 2022 in total since um we started doing the performance audits um and since they were issued in 2019 there have been about 50 audit recommendations made as of May 2023 about half or 27 of those were still outstanding um most of the recommendations were from the year three and four audit not much time had passed that's sort of the hard part when you're doing these um audits

079annually you need a little bit of time to implement them sometimes um there's a couple recommendations that uh PBS asserts that can't be done until 2017 projects close out or at least new cmgc projects commence um we can talk about a couple of them um for um year four we had 10 recommendations in year four audit and four of those were specific to the cbse program that had mentioned needed uh many improvements you know getting a formal framework around management Staffing clear rules and responsibilities and really an updated implementation schedule with targeted milestones and a plan for either making Capital purchases or doing some Capital Improvements and then a structure to be able to monitor that progress against Plans um additionally there were eight recommendations in total related to business and Workforce Equity programs that

080were still outstanding and another eight project delivery related recommendations over the various audits related to things like um change orders um contract language for paying contractors value engineering um and design deviations and reporting of some other performance metrics um there was a BAC report that was issued in May 2023 that had mentioned several that PPS had closed out several of those outstanding recommendations but we could not verify that progress because we hadn't received um timely supporting documentation so looking forward we're we're currently doing the year6 um audit that's in progress um you can see here we're looking at at some of the same areas the 2017 and 2020 bond status the prior year recommendations um for this in progress audit cycle we're also looking at the 2020 fisical um facility infrastructure projects in more depth

081uh looking at Bond Staffing and bond oversight so that gets us caught up I hope I get got caught up on some time as well thank you for sticking with me to the end and I'm happy to answer any questions you might have sherw I need to leave in just about five minutes go i' have very few questions would you mind if I go if that's all right great thank you um thank you for that uh both the audit and that report it was actually I I really appreciated your slide deck walking through all the different pieces um I I want to oversimplify but I want to know if my takeaway is accurate um from reading through this what I mean what the audit generally found is um uh is effective implementation right of these

082bond funds in most areas you did note the uh Center for black student Excellence delays and sort of a lack of progress there which again I think is an issue that the board is aware of um and it's you know showing up again in this spending plan so I think it's a it's a it's a good conversation for the board to have with the superintend of the team in terms of what that plan is um then a really significant um you know sort of attention on on sort of the failure to implement prior year recommendations but is is that sort of an accurate takeaway um we need to do a better job doing prior year recommendations we need to keep a focus on the cbse otherwise these Bond spending programs look really on track yeah

083they're they're at that the time of that audit they were generally progressing as planned and on target to be completed um the only thing I would add is you know the equity program need some attention as well yeah no thank you and I actually um yeah no I appreciate you raising that and and what I found really interesting about that you you've made a lot of I think effective recommendations for staff to look at I I wonder if the board doesn't need to work with the superintendent on sort of um maybe better defining I mean that that program is pretty it was passed a long time ago right um and uh in fact you noted in there what year and I can't remember um but it I wonder if there's not a I wonder if

084this is not a good point to sort of go back and say what's the goals of that what are we trying to get out of it have we defined it accurately as a board so that staff are really clear and then you know again what are the resources that we want to put into that because it seemed like a lot of these recommendations are just we need to put some more and I'm gonna always say it administrative resources um on working through that program um but yeah no I appreciate you raising that as well I'm sorry I can't stick around for the rest of the discussion so thank you for letting me letting me go yeah you're welcome um I do have one quick question um and please excuse me this is my first year

085on the audit committee so this might be a little general so my question is about the um curriculum and and Technology audit um we was just wondering you know those are very like very you know school specific type of um uh deals right so do you do you have um curriculum and Technology experts on your team that when you look at curriculum and technology and and auditing how how that uh money is spent let me describe to you what we do so we're not looking to make sure that the proper curriculum was put in place or the right subjects were um purchased we're looking to see if there's a framework in place and that roles and responsibilities are defined and progress is being monitored to make sure that things stay on on scope within scope

086on budget non Target so we're not looking to second guess the decisions that um curriculum experts are making we're looking to make sure that um they're considering all the things that they considered and they have the framework in place to make sure that they're spending the money in in within the intent of the bond for technology it's a little bit different I mean it's the same thing that we look at but we do have um technology experts that we call upon if we need to get into an area of something that doesn't make sense we would do that for curriculum you know as well if there was some decision that was made that you know needed some level of specificity that we didn't have but generally you know we're looking at it the performance of

087it and and making sure that it's um meeting the intents of the bond thank you yeah yeah that was actually very helpful yeah because my curiosity was around like um yeah exactly like the the framework that you use to to examine um the money used for curriculum and Technology G thank you any other questions yeah I'm done director suvan do you have any questions um not a question I guess more of a comment well yes a question it was kind of what you said uh director long because we have a bond accountability committee I was kind of wondering should do we need someone on there with curriculum and Technology expertise or as you said just kind of make sure that it's operating as it should is that a question for me yeah for you okay

088um yeah so funny you mentioned that you know we are looking at Bond oversight um as part of this audit um it's different and um a performance external performance auditor has a different role than your bond accountability committee who are your technical advisors on the project so um those are the types of things that we would look at to see if you know the the um that committee has the requisite ex expertise to be able to provide that technical advice so that would be a good idea to get well it's something we look at I can't tell you what's in the audit yet it's not done yes but those are the types of things we would we would look at and consider all right thank you go should I go Eddie yes yeah go ahead

089sorry um so uh thanks so much for the presentation um I think I was on the first uh hiring committee for you in 20 your firm in 2018 coming off of the 2017 bond that was um grossly Miss estimated um and so subsequently from then I've appreciated the sort of independent look at um our bond programs um I'm curious though we didn't get this report till this fall and the contract has the report being needing to be delivered to the Board of Education by June 30th and I'm just I've got a number of questions which is about like our protocols and how we're given that we have over a billion dollars in taxpayers money um the need to be sort of responsive and obviously in our bond language we talk about um the fact that

090we have independent auditing um so I'm just curious why we we didn't get the bond audit until the delivered to the board from you all until this fall well we don't deliver the report directly we work through osm so we deliver the report to them a draft report and then we um I think I mentioned before we get the views of responsible officials so we need to get their comments and report so we're um dependent on when that comes in and then we finalize the report and give it to them for distribution we don't um I don't believe in our contract have authority just to I don't even know how we would directly give that to you just follow you could just email it to us um so are you saying that you didn't have

091man the management response before June 30th yes or was it all completed and we just didn't get it yes we got the um I would have to look at the specific timelines but it it took a little bit longer with that cycle to get the management response so just in the context of of the board's um fiduciary responsibilities in the audit committee is like I feel like we need to really tighten up um our role versus staff's roles because there's in auditing you have the Auditors management and then the board and um I'm concerned that we're just getting it now we're getting ready to roll out another very significant Bond um and also so um that the scoping this year like the board is my understanding didn't have any um and the audit committee didn't

092have any engagement in terms of what projects were scoped for the versus it was being scoped by staff um and I guess this is this is a request to the board audit committee and the District staff um and the Auditors is that just normal protocol I serve on two other boards where I'm on a public entities where I'm on the audit committee and there's always like an audit initiation there's usually engagement with the members of the audit committee about potential topics risks you know fraud which we know that um there's not any good news but um I'm concerned that we ski that step this year um and I know that staff has a lot of valuable insights um and things that would be valuable for staff but I also believe that the um we have

093a responsibility um at the end of the day um we ask voters for the funds and we're responsible for ensuring and being good stewards um so I would just ask the Auditors and staff that we um re-engage a process in which the board is involved in scoping um or the audit committee and scoping the audit topics and also um that we at the end of the year get the get the audit when it's ready according to I say the contract has it us being getting it by June being presented to us by June 30th that we just maintain that because um we're asking taxpayers for a lot of money and I think it's just good practice um and I just add to that really quick I don't know if you're moving on to the next

094top no go ahead yeah I just want to add to that I think there was also an issue with the year four and five audit reports not being reported to the Bond audit committee as well so maybe this I my request would be this would be something that director Shanks in and uh OT Hansen I don't know if and working with um chair of the committee solvin to come up with a plan to make sure that doesn't happen again right in the future some kind of either it's a protocol or schedule or something so that uh we're not missing um these audit rep s and just have have something in place so that we don't this doesn't happen again yeah just like the board is the the board should be the client and we're I

095mean um get staff has a very important role um but at the end of the day the board is the client and should be reviewing the audit and then the management response and then um doing our job but I actually um so Andrea had some great I think call outs the other thing though that I think is missing and I'm just curious because I would I wouldn't consider this on track we're five years after the bond passed and there's Jefferson has not there's been no expenditures of funds from Jefferson either so we have about 450 million or almost $500 million doll that is not progressing is that is that a concern Katherine um as as of the time of the year five audit so we looked at just the um high level status of the

096project so again each cycle we can't go into depth and and everything is going on but it was it was going according to schedule at that time and so the cost there was cost increase budgeted they already knew that costs were coming in higher and they had plans in place to um fulfill those with contingencies so um at that time that was what we what we found and then I guess another like followup question is um there's been cost overruns at Benson that have occurred since then and is that something in this is not to last year's but this year's Bond even though it's not within scope that you would look at um if a project was um there were cost overruns because it the time of this report was done I think it makes

097it like we finished it on on budget but it sounds like we didn't is that something that would your auditing this year would capture I'm sorry I don't think I understood the question um about Benson um higher than expected expend so you had it on as part of this last year's audit because because we're talking about something in December that actually was done much earlier like right we now know there was cost overruns and my question is is that something that you would look into that as part of this year's audit cycle that you would review or is because it's not in scope you in the quote scope you wouldn't re review right so so um in order to determine everything would go on with this specific project like doing a deep dive on Benson

098which was one of the items that we suggested um as part of an audit scope it would be almost all of you know almost all the audit so um this year we are looking at I can tell you it's it's hard I can't discuss what's ongoing of the audit but we are looking at what's going on in general um with Benson and Jefferson and why the costs are increasing um you know some of it it can be a multitude of reasons right we I had mentioned that there was cost escalation that's that's out there that's in the market everywhere it could be um on you know poor project management practice IES which we've looked at in the past too you have to go in and and observe them and get evidence in detail is that

099a problem with change orders that aren't being uh managed is it a problem with pay apps that aren't being reviewed so trying to figure out or or was the design off or was the cmgc contract or not brought in at the right time so those are all things that we've looked at over time to see if there's practices in place to make sure that the projects are coming in as much as they can on budget um and so some of it tooo is you know is there money to be able to pay for those things or is it running into another Bond like you you had mention and that sort of thing so um we are looking those it just is when you're looking at M um a variety of different audit areas you can

100go this deep versus when you look at one or two and you can go into a lot more depth so I don't know if that answers your question but it is certainly it does but I almost think it's like a Miss opportunity because as it was Benson even on budget was the most expensive high school and then with cost runs will be even more now we're looking I mean we're pausing this year's um some of the work happening with our planning right now in order to look at what the costs were um so for me it's like somewhat of a missed opportunity um and I in some ways it seems like it connects to one of the recommendations that you had in last year's budget about conting agcy and and that um on page seven

101um you noted there hasn't been sizable cost savings um that have occurred in the past but we didn't have have a need for a formal procedure for allocating the funds um and while it's not a it didn't appear as a recommendation um I wish it had because um I think we should be very thoughtful about using our contingency so just moving like well we'll just move 55 million from contingency into the Jeff program without looking at like well why you know why are those numbers higher or you know paying for paying for Benson um with the second Bond when it looks like now we have 98 million um left it seems like that contingency becomes a little bit of like well uh it's our flux without being like really intentional about it um so I'm

102curious why why wasn't that a um recommen why wasn't that a recommendation in your report you called it called it out um but it wasn't a recommendation yeah we we hadn't done a lot of audit work in there because we're looking at that even just to figure out where things are on in terms of status to validate right because I know um osm is providing information to BAC and that sort of thing so we're trying to validate the numbers that they're providing but the amount of effort it takes to look at the cost the the schedule and the scope to see if they're generally on budget so we're trying to look at where there's large variances and is osm taking appropriate steps to um address those variances so contingency was was definitely one of those

103things and something that we discussed we didn't do a lot of audit work in that area to be able to come up with some recommendation there was talks about maybe that could be a future um audit area to go into more depth on that yeah I mean one recommendation uh chair Sven and Wong I guess there's chers um while it's not a finding of the audit I certainly think that we should be more um intentional about how the contingency are being used versus it's sort of like hey we have this extra money like um we value engineered some things out but we have some extra money or the project costs less or we had I mean the last in the 2020 Bond we had pretty significant contingencies for the whole Bond and then for each

104program area and well it wasn't an audit I mean they do they do mention it but I think we should be looking at that contingency and how it gets utilized because it's it's not an in 55 million million dollar is just like oh we're going to just put it over here in this other project um should be thoughtful what was it was what's the trade-off of what we could have spent with the other 55 million um apparently could pay for eight years of curriculum um so that would just be again a recommendation that we as we think about the the go forward with the next Bond um I had a question about the and maybe this is a question for staff around the and probably not for you stormy because you're relatively new and I

105realize a lot of this happened in your transition but um the you know more that the majority of the audit recommendations um not being implemented I don't know maybe that's a Dan question of why that didn't happen I'm about to go over the unimplemented recommend from the previous Cycles um just after this so I'd love to do a deive on them um but I I'm just curious about like what process do we have in place that because um generally I think most of the audit recommendations they were supposed to be implemented in six months and some of them are happening in six years so like this is more of a question about what's the not about the specific ones but what's the process by which we we get a oh I understand we have an

106independent auditor who provides recommendations what's the process by which the the recommendations because it looks like we concurred with them so it wasn't like we disagreed but we concurred but some of them didn't get implemented for another seven years so not like what happen but like what process do we have that that will be different and we'll be getting into a cycle because again we're as we get ready to go out for another Bond showing that we you know again it wasn't that disagreed they concurred but then they just never got imp me right so what we have in osm is a an audit implementation team and the uh work of that a implementation team is to take these recommendations and treat them as sort of internal change projects so we um identify folks to

107be responsible for them and they come up with a work plan and um find people to execute those tasks and it hasn't been as effective as it should be and we've had some turnover in you know I'm new and then our senior um business operations manager also that position's vacant since um September so um you know there's multiple reasons that go into that some of it's capacity some of it's the level of understanding of the what the auto recommendation means and what it conceptually looks like to execute it so one of the things that um that we're working on right now is a um a procurement process to hire a contracted program management position and this would be audit recommendation implementation would be one of the pieces of their scope so they would be that

108project manager that really holds us to task on these things um it can be difficult to execute some of these in the course of you know we've got to keep the projects moving and so you know one of the old ones is document management so we're generating you know many documents every day and so impl a change while we're you know the train is moving is is a challenge for us and so having that person who's um you know part of their scope as a contractor would be managing these projects and um really coming up with those um implementation plans those work plans and you know really holding us to task on those um great and when is that that person there's a posting posting for it and we are um going to be starting

109an RFP for it pretty soon probably in January it be a contracted it'll be a contracted position yes it'll be a new contract sorry Dr so we only really have like 12 minutes left before 7:30 I want to make sure that director suvan has some questions if we have some spare time come okay I thought she had to ask her so go oh great Dr Sal we also have two more things on the agenda so I want to get moving so I'm I have some other questions that I will send um I appreciate there was a transition and again this is partly on the board is like every like we absolutely have to be involved in like the scoping of like what things that we're interested in and I think um and feel like we

110need in order to be able to do our fiduciary um responsibilities and then just having the discipline of having the meetings and because there's nothing like a having a meeting about the audit to like generate a lot of activity um I also just one last thing um Katherine I know in your audit um recommendations they're all set up as like within six months but if the district said like we see this as actually a year and a half implementation um I'm assuming that they could come back to you and like it's not going to happen six months but we accept it and like the implementation is going to be much longer um so it doesn't seem like hey all Implement all these things within a six-month time period yeah actually I don't know where the

111six month came from so we've never said something has to be implemented within six months because sometimes they are going to take a longer time or It's when um that situation happens again where you're just if it's a design recommendation you have to wait till you're in the design phase again um but absolutely there's a difference between you know um not implementing or or not making any progress and needing to you know wait to have sufficient time and making sufficient progress so we would consider that when we would look at anything right it might be if if it was different you know only half have been implemented but that's all that can be done at this point right so um the the timeline is going to vary depending on what the um specific recommendation is

112and um so yeah we would be and and what happens along the way is we hold briefings so we try to talk about potential recommendations throughout the audit kind of vet them through like well what do you think about this and and that's where we get a lot of discussion on you know maybe something we're recommending wouldn't work or you know sure it's great but it might take longer so we try to provide that opportunity along the way um the same when we do an exit conference that we can talk through those things um and and try to help understand behind the intent our intent behind a recommendation so that it is clear and easier to implement yeah I think I'm maybe responding to the chart that we have that says generally anticipated within six

113months um so maybe we should give you more grace um if they're longer term because then it looks like well this is like seven years later but if it was a longer term um so partly in how it's Framing and setting expectations that um are reasonable for an implementation great done yeah I we're gonna we are going to get to this though I have one question that's next yes um thank you Katherine Brady and and SEC for all the hard work that's really valuable and we appreciate you being here and answering your questions very was very helpful thank you anytime all right next up we have um uh director Shanks do you want to um Move Along into the next topic which is the um status of implementation of the bond audit recommendations yes um

114did you want me to try to get on the virtual meeting and share this PDF or can I just speak to it I think you should speak to it because it's a it's very wor think it's pretty dense document yeah okay um so the um the document that you have in front of you is um the recommendations that are not completely implemented yet so we have not addressed the ones that have been completely implemented uh the first one that you see here is from the year one audit uh phase two and this is regarding document management protocols and training osm staff on those document management protocols we have made uh significant progress here we've identified 256 standard folders and subfolders that we uh will store standard documents in um and this has been partially implemented

115already the things that uh remain to implement are to develop a template folder that we can use as our standard for new project projects going forward uh develop that training material and deliver the training to the osm staff and contractors and then Define a process for continuous improvements um we found that with document management um particularly since 2019 our Technologies in PPS have evolved um you know they introduced Google drive to The District in that time and so that has really you know not only are we executing projects and developing documents every every single day that have to be stored and maintained but the technology that we have to do that is changing um pretty rapidly in the past few years so that's been a little bit of an obstacle to um completing this but

116we've made significant progress and we've implemented um parts of this plan already and we have a a completion date of February 2025 for this one uh the next one is from year two uh this one is regarding cmgc post project analyses for two projects uh the cmgc process is a an alternative Contracting method and the best practice is to provide a post project analysis that um kind of Compares what was expected from that Contracting method in our um original findings that we present to the Contracting board which is you all the Board of Education um where you approve us to use that Contracting method so the post project anal Anis kind of Compares what we expected with what we actually got talks about Lessons Learned um our our uh plan here is to um we've

117gathered some examples of um other Contracting agencies PP uh uh PCC I think city of Bend everybody uses the cmgc process a lot and there's um several available reports to use as examples so then we will uh kind of develop a post project evaluation template that we can use for our cmgc project projects we need to gather the findings in support of alternative Contracting methodology documents that were originally um issued uh and and uh reviewed with the board for the Lincoln and McDaniel projects and then gather the data analyze it write narratives ascendable the reports and then actually deliver the reports to the contract review board so again we'll have that one done um by February I um I'm not sure exactly what the obstacles were to creating this one um but we do have

118a plan going forward to get it done can I ask you a question about this is the one I had a question about yeah this almost seems like the question we're trying to get answered right now like why do our high schools cost so much and some suggested is like it's escalation it's like cost driving you know but then there are also people who who say it's because of the Contracting process and that's where we're going to find the savings is that I don't know if you've have experience with this somewhere else in your other professional life but is would that answer partly the like how um how the Contracting process drives cost changes from what were original estimates it does partially it definitely compares the the cost estimates part of the elements of the

119report are the original cost estimates what was the GMP what was the final um the final amount that was paid in the cmgc process so um what it doesn't address though is scope um between two projects um and so there are limitations to the report but the report is intended to um to give you information about whether the the cmgc process delivered on what the reason that you decided to move forward with that process to begin with rather than um the standard Contracting method um and for all so I think it could partially answer and for all of our high schools we've us used the cmgc process yes um so if we would have found something if we'd done this in whatever 2019 um we might have changed our process but we're continuing to use

120the same process but and we probably will for all of our high schools we probably will what this if we had completed these reports already and using them as inputs into future high school projects already it it's very unlikely that the report would lead us to decide on a different Contracting method what it might lead us to is um improved project management um strategies or cost management strategies or risk management strategies within the cgc Contex yes great thank you um just kind of for the sake of time and this is very important stuff and this is very rich I know the all the audit committee members have read through the document okay um I and I I feel like a lot of this stuff is probably going to be Revisited in future audit committee meetings

121so um I know uh maybe ask director Solin first if you have um any questions about this first and then if we can just just focus on the questions and kind of move on because I know we're going to come back to this and I have there there's some stuff in here that I I'm pretty sure going to we like to follow up on later so yeah thank you yeah the information that has been sent out was very thorough and it was um I was really happy that to read it and thank you so much stormy you're welcome appreciate W one thing that I'm wondering on just because we had a very rare event as part of the Benin project we had an on-site death that there is an audit recommendation about requiring General Contractors

122to consistent report specific safety performance data to osm I'm just curious if I don't need an answer now but I'd like to know where we are with that yeah again I can't recall in 30 something years that we've had a on-site construction related death so yes it's a very rare occurrence um in construction in general not just at PPS but so I don't need the answer now but I would be interested in like where we are in terms of implementation yes so I can actually tell you right now um we have um we have processes that are automated that um project managers complete monthly status reports and those monthly status reports require them to gather information from contractors and so we are um we're testing right now that updates to that automated process to have

123those be as required fields and then the other thing that we need to do um that's not done yet is to update our actual contract language to create the requirement that the contractors um deliver those pieces of information to us on a monthly basis great thank you right thank you really appreciate this documents actually enjoyed reading that this was very good um I wasn't expecting that y well it it helped a lot the way it was formatted and it's good to see this kind of work being done good um thank you it's appreciate um all right next up want to move on to the next topic uh which is the update on the role of the audit committee on the RFP process for external Auditors Chief meang I think you have the you have the

124floor a little past your hoped for adjournment time so I can uh for my part try to make this fast so at your October 29th your last meeting on October 29th we shared some information about the process for the solicitation uh proposals for the the um upcoming the future audits similar to the scope of work that was presented uh at the beginning of this meting meeting and won't repeat all of that but uh we did put together a little document um that's posted on board book which includes the the key dates for that process and then just to focus as uh our understanding for for this topic tonight uh we we wanted to focus on the role of the audit committee as part of the selection ction panel for evaluating proposals uh which are due

125on January 8th so just to recap we we are bringing a proposal that contemplates five members fi a member five member panel of evaluators and the composition of of that group would be two PPS staff members to be selected by the superintendent uh one PPS internal auditor uh board member one PPS board member with a note that that could be the chair of the audit committee director Sullivan or um if preferred uh the chair of the audit committee could ask another board member and we're proposing preferably an audit Committee Member to serve as their designate and then uh one audit committee Community member preferably with relevant experience and our understanding and I don't want to put anybody on the spot is that we may have a a member of U of the audit committee uh

126serving as a community member who is very well qualified to to serve in in this capacity over the next couple of months and then there's a one additional paragraph that sort of reflects some some Forward Thinking uh considerations that may apply to a to future solicitations for external audits services that if a a composition that looks like this which we think and hope will will apply and work for for this specific solicitation if the composition of the audit committee or or others uh doesn't end up being as suitable for future solicitations we did want to just capture some of the discussions that we've been having I want to thank Janice Hansen for for all of her work and and good research about this as well as well as board members so in as much as

127we are discussing this pretty actively over the last several weeks we wanted to sort of memorialize some of the thinking that should this specific configuration not be suitable for a future solicitation whenever that might come about then the board may want to consider alternatives so for example one one particular example that's noted in the document in the little memo is that if if a suitable audit committee Community member is not available at a given point in the future that perhaps another board member could serve as a fifth member of a selection panel so that's I think I'll stop there unless you have questions for me any questions no I I appreciate the process and it sort of complements some of the things I've raised during the meeting with having the board um again this is

128part of our oversight and really being the independent because we're not management um having the independence and also um I find when Auditors are hired by um board with board member involvement that they realize the client is the board member not staff so I'm supportive of this um process I think it um has um a majority of the committee members being either audit audit committee members or board members and um I think that's an important part of the process so I know it's a collaborative job putting it all together um so I appreciate bringing it forward thank you director Sullivan um yes I think we've talked about it a lot and I think we've come to a good solution I know that um uh Janice Hansen wants to make sure it will go on you

129know for the next year too just in case there's a problem with a having a Community member she wanted to be Shar and and I do too that we would would have a a group that would work so I think this this is a good one it's been talked about and I think we've worked it out thank you I concur to name this looks good all right there's any last words last words that sounds bad um uh I think um Miss Brash I think I heard you say there's no no one signed up for a public comment no there's not okay thank you Chief me I really appreciate it um all right don't think there's any anything left I think I don't know if there's again uh chair Sal I don't know if you usually

130spend a little time at the end to talk about future topics or not um so I'll refer to you since I'm just your substitute today oh future topics for board meetings or for uh yeah the audit committee audit committee meetings um no I have nothing in mind right now so I send it back to you okay I have one or two but I'll I'll share with you individually and figure out the best way forward okay thank you so one thing to um suggest um since we have the that work plan grid is to put on the um the work plan grid um the presentation of the because if it's on the work plan then then it tends to happen the sort of uh this year's Bond audit um and then also the sort of audit

131the bond audit entrance conversation um which again is this they solicit solicit um ideas for what they should be auditing from staff but also very importantly from board members and just to make sure that happens so if you get that if you put that on like the May agenda or April a agenda um of like that's just part of the routine setting up next year's audit um then it's just more likely to happen and again I know there was a staff transition this year um in osm but we should make sure the audits know that Auditors know that they have a responsibility um and are reporting to ultimately their product is for the board yeah I agree I like that thank you all right with that um thanks for staying late uh this meeting is

132adjourned thank you appreciate your work thank you

This transcript may contain errors introduced by automated or source-provided captioning. Bracketed descriptions such as [Music] are retained from the source. Passage divisions are editorial aids and do not alter the wording.