Link

Social

Embed

Disable autoplay on embedded content?

Download

Download
Download Transcript

[00:00:04]

OKAY. 6:00. WE'LL START THE CITY COUNCIL WORK SESSION FOR THURSDAY, SEPTEMBER 4TH.

[1. CALL SESSION TO ORDER]

I'LL START WITH ROLL CALL. COUNCIL MEMBER. THOMPSON. COUNCILMAN.

MORRIS. HERE. COUNCILMAN. GORDON HERE. COUNCILOR PORTERFIELD HERE.

STARTING HERE. MAYOR PRO TEM THORNTON HERE. AND MAYOR SHADOWS HERE.

FIRST ITEM PRESENTATION. DISCUSSION OF ARTIFICIAL INTELLIGENCE POLICY ENFORCEMENT MEASURES.

[3.1. Presentation and Discussion of Artificial Intelligence Policy and Enforcement Measures. (David Amsler)]

GOOD EVENING, MAYOR AND COUNCIL, DAVID AMBLER, DIRECTOR OF STRATEGIC OPERATIONS. FOR THE RECORD.

WE ARE HERE TODAY. I KNOW THERE'S ANOTHER AGENDA ITEM TODAY, SO WE DON'T HAVE TO OVERLY GET IN DEPTH TODAY, BUT AS A BEGINNING DISCUSSION WITH COUNCIL TO GAIN A LITTLE BIT MORE DIRECTION ON WHAT YOUR INTENTION IS WITH AI IN THE CITY.

AI USE IS EXPANDING IN CITIES WITHIN STAFF WORKFLOWS.

THE TEXAS LEGISLATURE ALSO PASSED A SURPASSED A FEW ITEMS THIS YEAR REGULATING AI.

WHAT WE HAVE IN FRONT OF YOU FOR THE POLICY PUTS US IN COMPLIANCE WITH THAT TEXAS STATE LAW.

BUT ALSO NEED SOME DIRECTION ON THE ENFORCEMENT PIECE WHEN IT COMES TO AI.

SO KEY RISKS WITH AI IS UNAPPROVED AI TOOLS, STAFF USING OUTSIDE APPS WITHOUT OVERSIGHT DATA SECURITY, SUCH AS RISK OF PERSONAL PERSONALLY IDENTIFIABLE INFORMATION OR PROTECTED HEALTH INFORMATION BIAS AND ACCURACY OUTPUTS MUST BE VERIFIED.

WE COULD HAVE AN EMPLOYEE. I'M NOT SAYING THAT THIS IS HAPPENING, BUT WE COULD HAVE AN EMPLOYEE USING AI TO MAKE CRITICAL DECISIONS IN GOVERNMENT.

THE TEXAS STATE LAW REQUIRES THAT THERE'S HUMAN OVERSIGHT THERE, THAT A HUMAN HAS TO ACTUALLY MAKE THAT DECISION.

ONCE THE OUTPUT IS DONE. AND PUBLIC TRANSPARENCY, RESIDENTS SHOULD KNOW WHEN THEY'RE INTERACTING WITH AI, SUCH AS CHATBOTS, WHICH HAVE BEEN AROUND FOREVER.

THAT WOULD BE CLASSIFIED AS AI. IF WE DID HAVE A CHATBOT ON OUR WEBSITE, WE WOULD HAVE TO DISCLOSE YOU ARE INTERACTING WITH AI.

CURRENTLY, THE WAY THAT THE LAW READS, IT EVEN SAYS EVEN IF IT'S OBVIOUS.

SO EVEN IF IT'S A LITERAL ROBOT TALKING TO YOU, WE NEED TO DISCLOSE THIS AI.

CURRENT DRAFT POLICY APPLIES TO ALL STAFF, OFFICIALS, AND CONTRACTORS FOR THE CITY OF HUTTO.

PROHIBITS SHARING CONFIDENTIAL PII DATA, BEHAVIORAL MANIPULATION, SOCIAL SCORING.

THAT'S THAT'S AN INTERESTING ONE. THAT IS A LITTLE VAGUE, BUT ESSENTIALLY, WE ARE NOT ALLOWED TO USE AI TO ESSENTIALLY SCORE DEMOGRAPHICS OR PEOPLE BECAUSE OF A POTENTIAL FOR BIAS OR DISCRIMINATION AGAINST A GROUP OF PEOPLE.

WHAT IS PII? IT WAS ON THE PREVIOUS SLIDE. RISK OF PERSONALLY IDENTIFIABLE INFORMATION TO REQUIRES HUMAN REVIEW OF CONSEQUENTIAL AI DECISIONS. DISCLOSURE OF AI CONTENT AND ADDITIONAL.

ENFORCEMENT CHALLENGE. SO POLICY IS ONLY EFFECTIVE IF IT'S ENFORCED WITHOUT ENFORCEMENT RISK.

INCLUDES UNAPPROVED AI USAGE, LEGAL GAPS, AND PUBLIC TRUST ISSUES.

SOME EXAMPLES. IS AN EMPLOYEE USING PERSONAL CHATGPT TO DRAFT A LEGAL MEMO? DEPARTMENT EXPERIMENTING WITH FREE FREE AI APPS WITHOUT ANY IT OVERSIGHT, AND THEN UPLOADING SENSITIVE CITY INFORMATION INTO AN OUTSIDE AI TOOL. SO IN YOUR HANDOUTS TODAY THERE IS A SOLUTION THAT COULD HELP TREMENDOUSLY WITH THE ENFORCEMENT PIECE. AND ESSENTIALLY WHAT THIS SOLUTION WOULD DO, IT'S CALLED DARWIN IS IT'S IT IS AN AI.

IT'S AN AI MONITORING AI. AND THAT'S THAT'S KIND OF THE DIRECTION WE SEE A LOT OF THINGS GOING.

BUT WHAT IT DOES IS IT WOULD COME INTO OUR NETWORK ENVIRONMENT HERE AT THE CITY OF HUTTO.

WE WOULD UPLOAD WHAT OUR ARTIFICIAL INTELLIGENCE POLICY IS AND WOULD MONITOR OTHER AI SUCH AS CHATGPT.

SO IF AN INDIVIDUAL EMPLOYEE WAS BREAKING THAT POLICY WOULD ACTUALLY PREVENT IT.

SO WOULD SPEAK TO THAT AI AND SAY, HEY, THIS IS NOT WITHIN THE REALMS OF OUR POLICY AND STOP IT FROM HAPPENING.

IT WOULD ALSO FLAG IT FOR US SO THAT IT WOULD BE AWARE OF WHEN THIS THIS PROBLEM OCCURS, SIMILAR TO WHEN YOU GET A PHISHING ALERT.

IF YOU'RE SOMEONE WHO CLICKS ON THE PHISHING, IT IS INFORMED OF THAT, AND THEN YOU'RE AUTOMATICALLY ENROLLED IN TRAINING.

IT ALSO DOES HAVE AN ANNUAL SUBSCRIPTION COST, WHICH IS AROUND 27,000 A YEAR.

SO OBVIOUSLY I KNOW THIS COUNCIL COST IS IS A GREAT CONCERN FOR YOU ALL.

SO POTENTIAL ALTERNATIVE THAT WOULD BE FREE WOULD BE FOR US TO BLOCK OUTSIDE AI SUCH AS CHATGPT IN THE CITY. SO ANYTIME SOMEBODY, WENT ON THEIR COMPUTER AND TYPED IN CHATGPT THEY WOULD NOT BE ABLE TO HAVE ACCESS TO IT AND INSTEAD HAVE A CORPORATE ACCOUNT WITH CHATGPT OR A CORPORATE ACCOUNT WITH COPILOT.

[00:05:03]

THE DRAWBACK TO THAT IS AI IS EVER CHANGING, AND IT COULD LIMIT OUR COMPETITIVE ADVANTAGE.

IF WE CHOOSE A TOOL THAT IS NOT NECESSARILY THE BEST TOOL FOR ALL CASES.

SOMETHING ELSE THAT DARWIN DOES IS IT WOULD HAVE AN INTERFACE LIKE ESSENTIALLY A LANDING PAGE FOR ALL OF OUR EMPLOYEES.

AND IF YOU WERE USING CHATGPT FOR A TASK THAT COPILOT IS ACTUALLY BETTER AT DOING, IT WOULD INFORM YOU OF THAT AND SAY, HEY, WE NOTICE THAT YOU'RE TRYING TO USE DATA IN SPREADSHEETS.

CHATGPT IS ACTUALLY NOT BEST AT THIS TOOL. HOWEVER, YOU COULD USE COPILOT, SOMETHING ELSE I WANTED TO BRING TO COUNCIL'S ATTENTION BASED OFF THE JUNE 18TH MEETING. THERE WAS A PRETTY CONSENSUS CONCERN OVER OUR WEBSITE AND HOW WELL THE SEARCH FUNCTIONALITY IS. IN SPEAKING WITH OUR CURRENT PROVIDER, CIVICPLUS THEIR RECOMMENDED SOLUTION TO IMPROVE SEARCH FUNCTIONALITY IS ACTUALLY THE CHATBOT BECAUSE IT USES LARGE LANGUAGE MODELS IN ORDER TO BETTER UNDERSTAND THE QUESTIONS THAT SOMEBODY IS SEARCHING RATHER THAN THE TOOL OF THE SEARCH BAR, WHICH IS JUST LOOKING FOR KEYWORDS BECAUSE IT WOULD HAVE INTELLIGENCE BASED OFF IT TO EVEN IF MY KEYWORDS ARE NOT NECESSARILY TAGGED IN THE DOCUMENT IT CAN PICK UP WHAT YOU'RE TRYING TO DO AND BE ABLE TO PUT YOU IN THE RIGHT PLACE.

THAT ALSO HAS AN ANNUAL SUBSCRIPTION COST, WHICH IS JUST UNDER 5000.

SO REALLY DIRECTION THAT STAFF IS LOOKING FOR IS IF WE ONLY WANT TO ADOPT THE POLICY IN ORDER TO BE IN COMPLIANCE WITH TEXAS STATE LAW TO BRING THAT BACK TO COUNCIL AT A LATER DATE.

IF YOU WOULD LIKE FOR US TO CONTINUE EXPLORING THE ENFORCEMENT PLATFORM DARWIN, OR IF YOU WOULD LIKE FOR US TO EXPLORE THE ENFORCEMENT PLATFORM PLUS CIVIC PLUS. AND THEN OBVIOUSLY A FOURTH OPTION HERE WOULD BE WE JUST WANT TO EXPLORE A CHATBOT ON OUR WEBSITE TO IMPROVE USABILITY. THAT IS ALL I HAVE AND HAPPY TO TAKE QUESTIONS.

WE ALSO HAVE DAVID REEVES HERE, OUR IT MANAGER, TO ANSWER ANY SPECIFIC TECHNICAL QUESTIONS.

CAN YOU GO BACK TO THAT SLIDE THAT YOU HAD UP? FROM AN IT PERSPECTIVE? DO WE HAVE ANYTHING THAT WE BLOCK RIGHT NOW OR IS IT FOR STAFF IS LIKE CHATGPT ALLOWED BUT NOT ANOTHER WHATEVER AI. YES. WE DON'T BLOCK A WHOLE LOT RIGHT NOW.

BUT IF SOMETHING TAKES ONE OF OUR SECURITY PROGRAMS. IT'S LOOKING FOR IT. WE GET NOTIFIED. IT DOESN'T NECESSARILY BLOCK IT RIGHT NOW.

IT JUST FLAGS AND LET YOU KNOW THAT THEY ACCESS THE SITE, OR THEY SAW A KEYWORD OR WHATEVER.

OKAY. HOW DOES THIS NECESSARILY I DON'T KNOW ABOUT ENFORCEMENT, BUT AT LEAST DETECTION IS WHERE WE RECEIVE AI TYPE MESSAGES. OR IS THIS A REAL PERSON? DOES ANY OF THIS ENFORCEMENT WORK? OR IF THESE TOOLS ARE ANY OTHER TOOLS, IS THAT A PART OF IT? LOOKING AT AI THAT'S COMING INTO THE SITE, NOT FROM INSIDE THE SITE, INSIDE CITY, BUT OUTSIDE OF CITY COMING IN.

NOT THAT I KNOW OF, BUT OUR LIKE EMAIL TOOLS CAN DETECT SOME OF THAT.

OKAY, THE SECURITY THAT'S IN OUR EMAIL TOOLS, WHICH ACTUALLY USES SOME AI TO DO THAT.

RIGHT. BUT IT CAN DETECT PROBABLY NOT ALL OF IT BECAUSE AS DAVID SAID, IT'S ALWAYS CHANGING.

BUT WE DO HAVE EMAIL TOOLS TO TO DETECT SOME THINGS THAT COME IN THROUGH EMAIL.

AND THAT WAS MY CONCERN IS EMAIL, BUT I WOULD HOPE THAT EVOLVE AND I ASSUME DIFFERENT PLATFORMS, WHETHER THESE THESE OPTIONS OR OTHER OPTIONS, THAT'S SOMETHING THAT WE ONGOING LOOK AT.

AND WE OUR EMAIL TOOLS WILL EVEN QUARANTINE CERTAIN EMAILS.

IN FACT, IF IT'S REALLY BAD AND OBVIOUS, IT REMOVES THEM.

RIGHT. AND THEN WE PUT IT IN QUARANTINE. I GET LOTS OF QUARANTINE EMAILS, MAYBE AVERAGE ONE, 1 OR 2 A DAY. OH WELL, LET'S SAY 10 TO 10 A WEEK.

NOT ALL OF THAT IS AI. OF COURSE. SOMETIMES IT'S FROM THE SENDER THAT'S NOT REALLY SECURE WITH THEIR THEIR EMAIL FACILITIES.

SO THE PROVIDER OF THE CHATBOT, WOULD THEY INDEMNIFY US AGAINST ANY ISSUES? BECAUSE ONE THING I'VE SEEN WITH CHATBOTS, I SAW A CASE WHERE AN AIRLINE HAD A CHATBOT AND SOMEBODY TRIED TO USE IT TO TRY TO FIND OUT HOW TO TRY TO GET REFUNDED ON SOME FEES. AND THE CHATBOT ENDED UP TELLING THEM THAT THEY COULD HAVE A FULL REFUND OF EVERYTHING.

AND THE AIRLINE THEN SAID, OH NO, NO, NO, THE CHATBOT WAS WRONG.

SORRY. THEY TOOK HIM TO COURT. THE COURT SAID THE CHATBOT WAS REPRESENTATIVE OF THE AIRLINE AND MADE A PROMISE.

YOU GOTTA FULFILL IT. SO YEAH, WE YOU KNOW, SOMEBODY DOES THAT WITH DEVELOPMENT FEES OR SOMETHING, AND ALL OF A SUDDEN WE'RE OUT, YOU KNOW, $100,000 ON A PROJECT, YOU KNOW, BECAUSE THEY TRICKED THE CHATBOT INTO TELLING THEM IT WAS FREE.

YEAH. WE WOULD MAKE SURE IN THE LEGAL CONTRACT THAT THAT THAT THAT WOULD BE COVERED.

[00:10:04]

AND. I'LL SAY THIS, I'LL READ TWO SENTENCES. THIS IS A HEADLINE OF AN ARTICLE FROM A WEEK AGO.

AI MODELS ARE LYING, BLACKMAILING AND SABOTAGING THEIR HUMAN CREATORS AND ONLY GET WORSE.

AND IT SAYS HOW THEY'RE NOW SCHEMING PEOPLE HAVE BEEN BUILT IT.

AND THIS CAME OUT FROM THE OPUS FOUR. BUT I KEEP READING MORE AND MORE.

AND IT WAS A PERSON WHO JUST KILLED, DID A MURDER SUICIDE BECAUSE HE GOT TOO CLOSE TO THE AI.

AND THE AI WAS, LIKE, COMFORTING THIS PERSON TO THE POINT TO WHERE IT CAUSED HIM TO, LIKE, BELIEVE WHAT HE WAS BEING TOLD. AND AI BOT WAS TELLING HIM, YEAH, THEY SHOULDN'T BE DOING THIS TO YOU.

TO ME. LIKE MY WORK, WE'RE NOT ALLOWED TO USE AI AT ALL BECAUSE IT'S UNCONTROLLABLE.

NEVER MIND WHERE IT STARTS OFF THIS WAY, BUT IT'S BRINGING ITS WAY INTO EVERYTHING.

AND THEY CAN'T. THEY DON'T THINK THEY CAN CONTROL. I'M NOT IN FAVOR.

HONESTLY. I KNOW YOU SAY COMPETITIVE ADVANTAGE.

OUR COMPETITIVE ADVANTAGE. I DON'T THINK AI IS GOING TO HELP US.

OUR COMPETITIVE ADVANTAGE IS KEEPING THE COST OF BUSINESS LOW, KEEPING THE SPEED OF BUSINESS FAST.

AND I AM TERRIFIED OF AI GETTING TO WHERE ALL OF A SUDDEN, LIKE, YOU GUYS ARE DOING PRESENTATIONS AND IT'S AI HELPED YOU AND WE SPEND MORE TIME TRYING TO KEEP ALL THAT. SO I'VE BEEN LOOKING AT THIS A LOT EVEN BEFORE THIS CAME UP.

I JUST HAVE NOT. AND I'M NOT THE BAD GUY HERE.

I'M JUST NOT A FAN OF IT. I THINK IT'S DANGEROUS AND I REALLY DON'T KNOW THE BENEFIT THAT IT GETS US.

BUT I DO SEE A BENEFIT TO THE CHATBOT THAT SOMEHOW CAN HELP FOR WHEN I WANT TO FIND AN IMPACT FEE CAN SOMEHOW GET ME THE IMPACT FEE TO LOAD UP LIKE A GOOGLE.

I ALWAYS IMAGINE A WEBSITE JUST HAD A GOOGLE, AND I KNOW HOW THAT WORKS, BUT SOMEHOW WHENEVER I GOOGLE IT POPS UP.

BUT SO, YOU KNOW, I DISAGREE. I THINK THERE'S, THERE ARE USE CASES THAT ARE FAIRLY SOLID.

I THINK GENERATIVE AI IS USED A LOT FOR IMAGE CREATION, AND I BELIEVE WE'VE USED IT.

AND IT'S GREAT AS LONG AS YOU MAKE SURE YOU TAKE A CLOSE LOOK AND MAKE SURE THE PERSON WAVING IN THE PICTURE DOESN'T HAVE A THIRD ARM COMING OUT OF THEIR BACK. RIGHT? BECAUSE THAT THAT HAPPENS. I THINK THE TOOLS AND TEAMS TO SUMMARIZE THE MEETING ARE GREAT AND VERY USEFUL AND SAVE A LOT OF TIME WHERE YOU CAN JUST GET A MEETING SUMMARY AND AND IF IT'S NOT ACCURATE, YOU STILL HAVE THE MEETING. YOU CAN GO BACK TO AND AND DOUBLE CHECK IT IF SOMETHING WAS MISSED.

BUT IT GIVES YOU NOTES ON THE MEETING RIGHT AWAY AND THAT I USE THAT AT WORK.

AND THAT SAVES ME TIME WHERE IF I MISS A MEETING I CAN, YOU KNOW, LISTEN TO THE MEETING IF I WANT TO.

OR I CAN SEARCH FOR SOME KEYWORDS AND FIND WHERE THEY TALK ABOUT THE SUBJECT I WANTED IN THE MEETING, OR REFER TO A MEETING I WAS IN, AND FIND A DETAIL THAT I THAT I WANTED TO REFRESH MYSELF ON.

SO I THINK THERE'S CASES LIKE THAT THAT ARE GREAT. THERE'S A LOT OF CASES OUT THAT I HEAR ABOUT OUTSIDE, WHERE LAWYERS ARE USING CHATGPT TO DRAFT LEGAL MEMOS, AND THEY'RE GETTING IN TROUBLE WITH COURTS BECAUSE THE, THE BECAUSE THE AI IS GENERATING FICTIONAL COURT CASES TO REFERENCE IN THE LEGAL MEMO, AND THEY'RE SUBMITTING IT TO THE COURT SIGNING OFF THAT THEY CHECKED EVERYTHING IN THE MEMO. AND THEN THE COURT FINDS THAT IT'S NOT A IT'S NOT EVEN A CASE, AND THE LAWYERS ARE ACTUALLY GETTING DISCIPLINED FOR IT. AND THAT'S HAPPENING ALL OVER THE WORLD, ACTUALLY. BUT SO THERE'S STUFF LIKE THAT WHERE PEOPLE ARE USING IT AND NOT BEING CAREFUL ENOUGH TO REALIZE THAT YOU CAN GENERATE SOMETHING WITH IT.

THEN YOU HAVE TO GO OVER IT AND YOU HAVE TO REALLY CHECK EVERYTHING.

AND YOU CAN'T JUST SAY, OH, THAT CASE HELPS ME.

I NEVER KNEW ABOUT THAT CASE. WELL, THEN YOU BETTER LOOK IT UP AND MAKE SURE YOU KNOW THERE'S A LOT OF DETAIL WORK THAT HAS TO GO INTO IT.

A LOT OF LAWYERS JUST REFERENCE A CASE, BUT THEY DON'T ACTUALLY READ THE CASE, AND IT DOESN'T REALLY STAND FOR WHAT.

YEAH. BECAUSE IT'S LIKE SORT OF ON TOPIC. BUT THEN IT'S OFF TOPIC IF YOU ACTUALLY UNDERSTOOD WHAT IT MEANT.

YEAH. YEAH. I DON'T SEE A PROBLEM WITH THE GOOGLE NOTE MAKING.

I GUESS TO ME THE PROBLEM IS I DON'T KNOW WHERE AI IS AI AND AI IS THE OTHER THING, BECAUSE THE THE GOOGLE NOTE WRITING AND YOU HAVE A CONVERSATION ON TEAMS AND IT COMES OUT TO ME, THAT'S A VERY USEFUL TOOL.

BUT THEN IF YOU SAID WE JUST WANT TO DO THAT, WELL, THEN IT'S NOT LIKE YOU GUYS ARE TALKING LIKE, HEY, THERE MIGHT BE A WAY FOR DIFFERENT PEOPLE USING DIFFERENT KINDS OF AI.

I JUST DON'T KNOW HOW YOU KEEP TRACK OF ALL THAT.

AND THEN I JUST DON'T WANT TO SEE US TO WHERE WE'RE SPENDING.

DAVID COMES UP, I NEED THREE GUYS BECAUSE IT TAKES A LOT OF TIME TO GO THROUGH AND CHECK ALL THIS AND ALL THE PROBLEMS WHEN IT'S LIKE, WHAT ARE WE REALLY GAINING IN EFFICIENCY SEE OTHER THAN LIKE THE NOTE TAKING. OR I COULD EVEN SEE.

YEAH. FROM IF YOU WANT TO MAKE A FLIER FOR SOME EVENT, THEY'RE A GOOD WAY TO DO IT.

BUT TO HIS POINT THIRD ARM. THAT'S NOTHING. SOME OF THE STUFF COULD THROW IN SOMETHING IN THERE YOU DON'T EVEN REALIZE WAS IN THERE.

AND THEN YOU FOUND OUT. YEAH, I, I DIDN'T MEAN TO PUT THAT IN THERE.

THAT WAS AN AI. BUT THAT'S NOT GOING TO BE AN EXCUSE.

SO I DON'T KNOW HOW TO. SO WHAT IS WHAT IS IF YOU CAN SPEAK TO IT.

WHAT WHAT IS STAFF WANTING TO USE AI FOR. LIKE WHAT WHAT SPECIFIC FUNCTIONS OR PROCESSES OR TASKS ARE WE.

[00:15:07]

WOULD WE LIKE TO SEE USED WITH AI OR TO ASSIST WITH AI? I, I THINK IT'S DEFINITELY CLOSER TOWARDS MAYOR PRO TEM GORDON'S IDEAS.

SO FOR EXAMPLE THE PD, WHEN IT COMES TO, YOU KNOW, SUMMARIZING CASES AND THINGS OF THAT NATURE, THEY, THEY HAVE FORBIDDEN USING AI THERE. RIGHT.

SO I'VE SEEN ACTUAL CASES WHERE THAT WENT BAD.

ELSEWHERE? YEAH. SO WHEN IT WHEN IT COMES TO HIGH PRIORITY HIGH RISK ITEMS, WE STILL WANT HUMANS INVOLVED IN THAT.

WHEN IT COMES TO ADMINISTRATIVE TASKS, IT COULD LIMIT THE THE AMOUNT OF TIME THAT GOES INTO THAT, SUCH AS SUMMARIZING MEETING NOTES. RIGHT. IT CAN BE DOING THAT ON THE FLY.

I DON'T ANTICIPATE US USING A TON OF AI TO TO DRAFT OUR BUDGET, FOR EXAMPLE.

BUT EVEN IN COMMUNICATIONS, LET'S SAY WE WANT TO SCRIPT A VIDEO FOR ENGINEERING.

IT WOULD BE HELPFUL FOR ENGINEERING TO SAY, HERE'S HERE'S SOME OF THE HIGHLIGHTS THAT WE WANT TO TALK ABOUT.

AND THEN BECAUSE THEY ARE NOT EXPERTS IN COMMUNICATIONS, FOR THEM TO RUN THAT THROUGH CHATGPT OF LIKE, HEY, HERE'S THE HIGHLIGHTS. HOW DO WE MAKE THIS SOUND MORE INTERESTING? AND THEN COMMUNICATIONS REVIEW THAT AND CREATE THE VIDEO FROM THERE.

THAT SAVES A LOT OF TIME FROM COMMUNICATIONS GENERATING THE SCRIPT THEMSELVES RATHER THAN JUST REVIEWING.

OKAY. ON THAT. SO THIS IS GOING TO SOUND NAIVE, BUT WHY WOULD ENGINEERING BE CREATING A VIDEO? WOULDN'T THAT BE COMMS? YEAH. FROM THE VERY GET GO.

BECAUSE I MEAN, MY GUESS IS THEY'RE THE ONES THAT'S TRAINED TO HOW TO GET PEOPLE INVOLVED AND HOW TO CATCH YOUR ATTENTION.

AND ENGINEERING PEOPLE ARE GOING TO BE DRY AND JUST BOOM, BOOM, BOOM TO THE POINT.

THANK YOU. BLACK AND WHITE. LIKE WE JUST TALKED ABOUT BLACK AND WHITE STUFF.

AND YOU GUYS BE LIKE, HEY, YOU GOTTA DO YOUR JOB.

YEAH. SEE, HE KNOWS MY MOM. WORKED. YEAH. SO IT IT WOULD BE COMMUNICATIONS.

I'M. I'M GIVING A HYPOTHETICAL EXAMPLE OF THAT COULD SPEED UP THAT PROCESS.

SO I CAN I CAN OFFER A REAL WORLD EXAMPLE, A REAL QUICK ONE.

I WAS TAKING JOB DESCRIPTIONS AND THEN BUILDING THE THE SUCCESS MATRIX.

BASICALLY, THAT WOULD BE GRADED. THE EMPLOYEE WOULD BE GRADED ON, AND THEN HAVING TO CREATE THE RUBRIC THAT GOES ALONG WITH THE MATRIX.

OKAY. SO THAT'S LIKE A TWO STEP PROCESS IF YOU WILL.

AND I DID IT MANUALLY THE WAY I WOULD NORMALLY DO IT, GOING THROUGH AND PULLING OUT THE KEY THINGS AND PUTTING IT INTO, YOU KNOW, EXCEL AND AND SO ON AND SO FORTH, AND THEN KIND OF GROUPING THEM ALL AND THEN SUMMARIZING IT AND THEN COMING BACK AFTER I GOT THE SUCCESS MATRIX KIND OF CREATED.

AND THEN I WENT BACK AND WAS LIKE, OKAY, WHAT IS A WHAT IS A 1 TO 5 SCALE? WHAT IS A ONE LOOK LIKE. WHAT IS A TWO, A THREE, A FOUR AND A FIVE? I DID ALL THAT, TOOK ME ABOUT 6.5 HOURS TO DO ON ONE EMPLOYEE.

THEN I WAS LIKE, NOW I'M CURIOUS WHAT WILL HAPPEN IF I USE CHATGPT TO DO THIS WORK.

SO AFTER ABOUT 30 MINUTES OF GIVING IT ALL OF THE SOURCE DATA THAT I NEEDED IT TO THE JOB DESCRIPTION, WHAT OUR PRIORITIES ARE, WHAT OUR PILLARS ARE, AND THAT SORT OF STUFF.

30 MINUTES OF SETUP I GENERATED AS GOOD, IF NOT BETTER OF A SUCCESS MATRIX AND A RUBRIC AND IN ABOUT 45 SECONDS.

SO IT TOOK MY 6.5 HOUR PROCESS MANUALLY DOWN TO LIKE LESS THAN 40 MINUTES.

THAT'S AN EXAMPLE BECAUSE IT'S USUALLY LIKE THE BIG ADMINISTRATIVE TYPE THINGS LIKE THAT, THAT IT'S REALLY TEXTUAL DATA DRIVEN WHERE THE AI CAN SHINE.

BUT ARGUABLY WE'RE NOT REALLY USING AI TOO TERRIBLY MUCH LIKE IN THAT TYPE OF A, OF A SETTING.

THE PROBLEM IS, IS THAT IT'S GETTING EMBEDDED INTO EVERYTHING THAT WE TOUCH.

WORD, EXCEL, YOU KNOW, IT HAS ITS OWN AI. YOU KNOW, THERE'S THERE'S LOTS OF SOFTWARES AND TOOLS THAT WE USE THAT ARE THAT ARE BUILDING AI IN BECAUSE OF THEIR DESIRE TO BE COMPETITIVE IN THE MARKET.

AND TO ME, THAT'S THE THING THAT I'M MORE WORRIED ABOUT IS THE THINGS THAT I MEAN, IT'S OBVIOUS IF YOU'RE GOING TO GO USE CHATGPT THAT YOU'RE USING AI.

BUT WHAT'S NOT SO OBVIOUS IS WHEN YOU'RE DOING A WORD DOCUMENT THAT YOU'RE USING AI WHENEVER YOU HIT COPILOT, YOU KNOW, THAT SORT OF STUFF. SO ANOTHER QUESTION.

SO LET ME ASK YOU THIS. CAN YOU IS THERE AN ABILITY TO LOG EVERY QUESTION OR STATEMENT EVER PUT IN? LIKE IF YOU ALLOW THREE CHAT, THREE AI'S OR WHATEVER INTO THE SYSTEM, CAN YOU GUYS TRACK EVERY SINGLE QUESTION AND EVERY SINGLE STATEMENT PUT IN THERE, OR ARE YOU ONLY ABLE TO TRACK THE OUTPUTS?

[00:20:01]

SO IF YOU HAVE A CORPORATE ACCOUNT, IT WILL MAINTAIN CHAT HISTORY UP TO AN EXTENT BECAUSE IT DOESN'T HAVE UNLIMITED MEMORY FOR FOREVER.

BUT YOU'RE ALSO NOT NECESSARILY QUOTE UNQUOTE GIVING IT ACCESS TO YOUR FILES AND STUFF.

YOU HAVE TO YOU HAVE TO MANUALLY LIKE WHENEVER I DID THAT, THAT EXAMPLE.

I PHYSICALLY COPIED A DOCUMENT AND I SAID, HEY, USE THIS DOCUMENT TO REFERENCE WHERE I'M GOING AS THIS IS PUBLIC INFORMATION.

YEAH. SO I WOULD WANT TO KNOW DAVID WRITES SOMETHING UP ON MY MONDAY, BUT HE'S BEEN HERE THREE YEARS.

THERE'S NO WAY HE DID ALL THIS. I'D LIKE TO KNOW WHAT KIND OF QUESTIONS DAVID ASKED AND WHAT KIND OF HELP DID DAVID GET? BECAUSE IN A WAY, AI, THERE'S PEOPLE I KNOW THAT USE AI.

YOU CAN JUST TELL BY THE WAY IT'S WRITTEN. THAT'S AI.

AND SOMETIMES YOU LIKE IT'S A CRUTCH. AND I ASK AI NOW QUESTIONS THAT I WOULD NORMALLY ASK GOOGLE.

YOU KNOW, WHO WAS THE LAST TIME THE ROYALS WON THE WORLD SERIES OR SOMETHING LIKE THAT? BUT THAT WOULD BOTHER ME IF WE DIDN'T HAVE A WAY TO TRACK THAT, BECAUSE THEN WE ALREADY GOT ENOUGH ACCUSATIONS FLYING AROUND.

LIKE, I DON'T KNOW WHAT WE'RE ASKING OR WHAT WE'RE DOING. AND THEN THE OTHER ONE OH YEAH.

YOU GUYS ALREADY KIND OF HIT LIKE, IF WE CAN VERIFY WHICH AI'S CAN BE USED TO WHERE.

I MEAN, I DON'T KNOW, IT SOUNDS LIKE YOU GUYS REALLY WANT TO DO THIS, BUT TO ME I THINK WE JUST GOT TO BE CAREFUL AND MAKE SURE WE'RE TRACKING IT TO WHERE WHEN SOMEONE DOESN'T ASK FOR INFORMATION LIKE WE DON'T GET DELETED AFTER 30 DAYS.

I DON'T KNOW WHAT THE TEXAS LEGISLATURE HAS FIGURED THAT OUT YET. YEAH.

SO THEY THEY'RE LOOKING TOWARDS THE DEPARTMENT OF INFORMATION RESOURCES, DER TO WRITE THOSE TYPE OF GUIDELINES RIGHT NOW.

AND THOSE GUIDELINES HAVE NOT COME UP. REALLY, ONE OF OUR MAIN PURPOSES TO TO BRING THIS TODAY IS SIMILAR TO WHAT CITY MANAGER SAID IS AI IS SURROUNDING US EVERYWHERE. WE HAVE EMPLOYEES THAT HAVE ACCESS TO THE INTERNET.

IT REALLY IS TO TO BUCKLE DOWN AND MAKE SURE THAT WE ARE FOLLOWING THE GUIDELINES AND ENFORCEMENTS.

WE CAN CONFIRM WITH DARWIN WHAT'S THEIR REPOSITORY WOULD LOOK LIKE ON QUESTIONS AND HOW MUCH THEY WOULD BE WILLING TO KEEP VERSUS NOT KEEP BECAUSE THEY WOULD HAVE ACCESS TO OUR NETWORK ENVIRONMENT.

SO THERE SHOULD BE A WAY TO DO THAT. BUT I DID NOT ASK THAT SPECIFIC QUESTION.

CAN EMPLOYEES GET ON THEIR PERSONAL DEVICES ON THE CITY WI-FI, WHERE THEY HAVE TO USE A GUEST WI-FI.

YES, THEY CAN GET ON PRIVATE. YES. NO, I SHUT ALL THAT DOWN TO WHERE I MEAN TO ME ONLY CAN ONLY SEE DEVICES SHOULD BE ON CITY NETWORKS BECAUSE YOU JUST OPENING US UP. YES. NUMBER UP TO. YEAH. TO WHERE ONE OF THEM ARE HOME DOING SOMETHING AND THEN THEY COME HERE AND IF IT SLIPS THROUGH, WE GET A RANSOM. I MEAN, THAT EMPLOYEE IS GOING TO FEEL TERRIBLE WHEN IT'S LIKE WE JUST PAID, YOU KNOW, ARE WE USING ANY KIND OF LAYER SEVEN FIREWALL TO BLOCK CERTAIN THINGS, OR DO WE HAVE ANYTHING THAT ROBUST? NO. THEY'LL TAKE YOUR PERSONAL COMPUTER OVER IF YOU LIKE. I'VE ALREADY TALKED ABOUT THAT.

NOT A LOT OF THAT. WE DON'T HAVE THAT MUCH EXPOSURE THAT WE NEED THAT LEVEL.

I HAVE A COUPLE QUESTIONS. ONE IS AI IS IS EVOLVING.

SO I REMEMBER IN GRAD SCHOOL IN THE 90S, ENDS WITH DOCTOR LA FORCE.

WE'RE DOING TEXAS RECONFIGURABLE ARRAY PROCESSOR, WHICH IS NOW THE SUPERCOMPUTER AT UT OF THE PICKLE SITE.

I JUST WANT TO BE CAREFUL THAT WITH ANY OF THESE LARGE LANGUAGE MODELS, THEY'RE LIMITED TO THE DATA SET.

SO THERE'S SOME OF THEM. I'M NOT FAMILIAR WITH DARWIN AT ALL. SO I'M NOT TRYING TO BE A CRITIQUE ON ANY OF THAT OR THE CIVIC PLUS.

BUT IF YOU DON'T HAVE SOMETHING THAT'S EXTREMELY ROBUST, VERY WELL VETTED AND HAS A LONG TIME HISTORY, I WOULDN'T EVEN CONSIDER AI, BECAUSE AI TO ME IS A 5050 BET ON ANYTHING.

YOU ASK IT BECAUSE IT'S A LARGE LANGUAGE MODEL.

I MEAN, THE THING THAT'S, THAT'S, THAT'S THAT'S THEY'RE NOT A GENERATIVE AI OR GENERATIVE WHERE IT ACTUALLY JUST TAKES ANYTHING, ANY CONTENT, AND IT COMES UP WITH BASICALLY UNIQUE ANSWERS.

THIS IS JUST POLLING FANTASTICALLY LARGE DATA SET AND GOING IN AND SAY, I CAN JUST HONE THIS DOWN BECAUSE ALL AI IS IS AN IF THEN STATEMENT, IF THIS, DO THIS, IF THIS, DO THIS, COLLECT IT ALL.

IT'S VERY SIMPLE HEURISTICS, BUT WHERE IT IS NOW AND WHERE IT WILL BE TEN YEARS WILL BE NIGHT AND DAY DIFFERENCE.

AND THEN THE FIVE YEARS AFTER THAT WILL BE ANOTHER NIGHT AND DAY DIFFERENCE, AND THEN TWO YEARS AFTER THAT. SO I THINK WE'RE JUST IN THE MIDDLE OF AI EVOLUTION LOOKING ALL THE WAY BACK TO THE MID 80S. THAT AND I REMEMBER MY ROOMMATES IN GRAD SCHOOL, THEY WERE THE LEAD.

THEY WERE THE STRATEGIC TECHNICAL MARKETING OF TEXAS INSTRUMENTS IN 1980.

AND THE THREE GUYS LIVED IN MY HOUSE. AND SO THIS HAS BEEN GOING ON FOR A REALLY LONG TIME.

SO I'M NOT SAYING THAT THERE ARE CERTAIN POINTS IN THE EVOLUTION OF ANYTHING THAT, HEY, THIS IS THE THING TO JUMP ON OR USE.

BUT SEE, I'D BE VERY, VERY CAREFUL BECAUSE WHENEVER I SEE AI STUFF, I JUST I CAN GO DO THE SAME THING WITH ANOTHER LONG LARGE LANGUAGE MODEL THING. TAKE A DOZEN OF THEM, AND IT'S JUST LIKE YOU GET A DOZEN PEOPLE TO TO GIVE A COMMENT ON IT, AND THEY SEE A SCENE OR TRAFFIC ACCIDENT, YOU'RE GOING TO A DIFFERENT DOZEN VIEWS.

[00:25:04]

NOW, MAYBE THE 50% OF YOU CAN BE CONSISTENT, BUT I'M NOT LOOKING AT THE CONSISTENT 50.

I'M LOOKING FOR THE LITTLE DETAILS BECAUSE I WANT TO PRODUCE THAT OR THAT, OR I WANT TO PROMOTE THAT, OR I WANT TO SHARE THAT. SO THAT'S WHY I'D BE REAL VERY CONCERNED ABOUT ANY TYPE OF LARGE LANGUAGE MODEL.

BUT I AGREE WITH ALSO WITH COUNCIL MEMBER THORNTON, THERE'S SOME THINGS THAT THESE THINGS ARE TAILOR MADE SUMMARIZING THINGS ADMINISTRATIVE CITY MANAGER SAID, YOU KNOW, THERE'S THINGS THAT ARE SPECIFIED.

SO AS LONG AS YOU DON'T, AS LONG AS WE VET THOSE THINGS THAT THE CITY WANTS TO USE THIS AS, I THINK YOU ASKED COUNCIL MEMBER. PORTERVILLE, WHAT DO YOU SPECIFICALLY WANT? AND THEN I WOULD SAY, WHAT DO YOU SPECIFICALLY WANT? AND THEN GO DO THE RESEARCH IS WHAT LARGE LANGUAGE MODELS REALLY HAVE A TRACK HISTORY, YOU KNOW, WITH THE IBM'S, THE FORTUNE 500 COMPANIES. I'M NOT SAYING WE NEED TO GO OUT AND SPEND $50,000 ON WHAT THEY DO, BUT AT LEAST UNDERSTAND WHAT THOSE MODELS ARE AND GET AND GET KIND OF GET IT TAILORED DOWN.

JUST TO GIVE YOU AN EXAMPLE, THE THE THE SWISS BLUE BRAIN PROJECT, WHICH WAS FROM 2005, THEY JUST FINISHED UP IN 2024 TO DO THE PROBLEMS THAT THE HUMAN BRAIN DOES TAKES ABOUT TWO GIGAWATTS. THE BRAIN RUNS ON 12W.

NOW IT'S AN APPLES AND ORANGES. ORANGES, BECAUSE THEY SPEND ALL THIS YEARS TRYING TO PUT DIGITIZING ALL YOU KNOW WHAT WHAT HOW DO YOU HOW DO YOU DIGITIZE HOW THE BRAIN IS WORKING.

SO I'M JUST SAYING THIS IS IN THE MIDDLE OF AN EVOLUTIONARY PHASE.

IT'S IT'S LIKE IT'S LIKE WHEN THE, YOU KNOW, WE CAME UP WITH THE V8 AND AUTOMOBILES AND PROBABLY, I DON'T KNOW, THE 50S OR 60S, THAT WAS HUGE THING.

ALL THE POLICE HAD THE V8'S BONNIE AND CLYDE HAD A V8, AND THAT'S WHY THEY OUTRUN MOST OF THE POLICE OFFICERS BACK THEN.

BUT THEN SPECIFICALLY ABOUT ABOUT THIS THIS IS ON THE PROCUREMENT OF GENERATIVE AI.

YOU TALK ABOUT THE CITY MUST COMPLETE A PRE PROCUREMENT RISK REVIEW IS CONSISTENT WITH NIST, THE NATIONAL INSTITUTE OF STANDARDS AND TECHNOLOGY, THEIR ARTIFICIAL INTELLIGENCE RISK MANAGEMENT FRAMEWORK.

SO I ASSUME THIS IS A I DON'T KNOW IF THIS IS STATE MANDATED OR I DON'T KNOW WHAT THE MANDATE IS, BUT ARE WE FAMILIAR WITH THAT PROCESS OF GOING THROUGH THAT RISK MANAGEMENT, YOU KNOW, MODELING AND REVIEWING? AND HOW MUCH DOES THAT COST? BECAUSE WE MAY HAVE A $5,000 PROGRAM WITH CIVIC PLUS, BUT IT'S A $15,000 FEE TO GO IN AND RUN THIS RISK.

I DON'T KNOW, I'M JUST MAKING WORST CASE. SO WE KNOW AND I DON'T NECESSARILY HAVE TO ANSWER THAT RIGHT NOW, BUT DO WE UNDERSTAND THAT PROCESS? BECAUSE I DON'T WANT TO GO IN AND LIKE BUILD A $100,000 PROJECT, A CITY THING AND THEN, OH, WE NEED TWO FTES FOR THAT.

NOW WE'RE IN A QUARTER MILLION DOLLARS, YOU KNOW.

SO AGAIN, JUST THE THING AND THEN THAT SEX ONE SECOND ONE WAS JUST BELOW THAT SAYS WHEN APPROPRIATE, THE CITY MAY TEST CANDIDATE AI SOLUTIONS TO THE SANDBOX PROGRAM.

AND QUITE HONESTLY, I DON'T I'M NOT FAMILIAR WITH THE SANDBOX PROGRAM, BUT IT BASICALLY SETS UP AN ENVIRONMENT WHERE YOU RUN IT THROUGH TO SEE HOW YOU KNOW THIS AI, THESE QUESTIONS, THESE PROCEDURES, AND YOU'LL PROBABLY KNOW A BIT MORE ABOUT THAT.

SO WE HAVE TO REALIZE THAT WHATEVER WE DO, IF WE IF WE TAKE THIS POLICY AND IT'S ASSUMING THIS IS MANDATED BY EITHER CERTIFICATION STATE OR FEDERAL OR WHATEVER IT IS, BUT THESE ARE NIST STANDARDS, WHICH IS A, YOU KNOW, THAT'S A THAT'S PROBABLY ONE OF THE BIGGEST ENGINEERING STANDARDS PLACE THAT'S BEEN AROUND FOR, I DON'T KNOW, A HUNDRED YEARS MAYBE. BUT ANYWAY, THOSE ARE THE THINGS I WANTED TO BRING UP, BUT I'M NOT THAT OLD. BUT YOU HAVE THE BOOK, YOU KNOW, YOU REMEMBER WHEN THE VA CAME OUT? BONNIE AND CLYDE. HOUSTON. OH, I READ ABOUT IT, I WASN'T THERE.

OH, THEY WERE USING A BROWNING AUTOMATIC RIFLE.

BRIAN. PETER, YOU GUYS ARE IN TECH? WELL, I WOULD HATE FOR US TO SAY NO TO AI JUST BECAUSE WE READ A COUPLE OF FRINGE THINGS ON THE INTERNET THAT ARE, LIKE, WAY OUT THERE AND THAT ARE REALLY UNLIKELY OF HAPPENING AND AND THAT, I MEAN, WE USE AI AT DELL. WE HAVE A POLICY. WE HAVE TO GO THROUGH TRAINING.

YOU KNOW, THEY TEACH US, YOU KNOW WHAT'S ALLOWED, WHAT ISN'T. THEY'VE LOCKED IT DOWN. TO WHERE? LIKE WE CAN'T USE CHATGPT.

YOU CAN'T LOG IN TO CHATGPT AT DELL. YOU CAN ONLY USE COPILOT.

AND THEY'VE, YOU KNOW, THEY'VE THEY'VE GOT LOCKED DOWN AND IT'S MOSTLY USED.

FOR WHAT? FOR WHAT DAN SAID. RIGHT. SUMMARIZING, MEETING MINUTES AND HELPING.

TO ME THE THE MAIN BENEFIT OF AI IS TO FREE UP TIME FOR HUMANS TO DO WHAT ONLY HUMANS CAN DO.

IF AI CAN WRITE MY MEETING MINUTES FOR ME AND I DON'T HAVE TO SPEND AN HOUR DOING THAT, GREAT.

I CAN DO OTHER STUFF THAT'S MORE PRODUCTIVE. AND SO TO ME, I THINK THAT'S WHERE I WOULD LIKE TO SEE US FOCUS IS HOW CAN WE USE AI TO, YOU KNOW, DO THINGS THAT THAT FREE UP TIME FOR US TO BE ABLE TO BE MORE PRODUCTIVE? IF WE CAN USE CHATBOTS TO HELP CITIZENS GET TO ANSWERS THAT ARE EASY TO FIND, AND IT'S JUST LIKE AN IF THEN STATEMENT, YOU KNOW, HOW DO I GET TO A CERTAIN SPOT? AND HOW DO I ANSWER MY OWN QUESTION RATHER THAN TRYING TO GET A HUMAN GREAT.

[00:30:01]

AND ALLOW THE PEOPLE TO. AND THEN ALSO MONITORING YOU KNOW ABSOLUTELY MONITORING.

IF IF I'M USING AI TO TO WRITE MY MEETING MINUTES I'M, I'M GOING TO REVIEW THEM.

I'M NOT GOING TO TRUST IT. YOU KNOW, JUST SAY RIGHT CLICK DONE SEND SEND IT TO ALL MY MANAGEMENT AND EVERYTHING LIKE WHAT IS THIS? SO ALL YOU HAVE TO DO IS READ ONE TRANSCRIPT FROM A COUNCIL MEETING, AND YOU'LL FIND OUT REAL QUICK.

YES. YOU TRUST THAT? SO YEAH, TO ME IT'S KIND OF YEAH.

BUT. THERE IS A REQUIREMENT IN THE NEW STATE LAWS FOR ANNUAL AI TRAINING.

AND THEN THE DEPARTMENT OF INFORMATION RESOURCES IS GOING TO COME OUT WITH AN ETHICS POLICY.

BUT NOBODY KNOWS IF IT'S GOING TO BE SIMILAR TO WHAT STAFF HAS ALREADY DRAFTED.

AND WE NEED TO WAIT FOR THOSE TO COME OUT FROM THE STATE BEFORE WE START ADOPTING OUR OWN.

OR IS THERE A CHANCE WE'RE GOING TO ADOPT SOMETHING, ONLY TO THEN HAVE THE STATE COME OUT AND MAKE OTHER REQUIREMENTS THAT THEY'VE GOT TO GO AMEND THEIR POLICY. IT COULD THEY COULD MAKE MORE COMPULSORY THINGS.

YEAH. SO YOU SAID SOMETHING EARLIER. IT SOUNDS LIKE THIS IS SOMETHING Y'ALL WANT TO DO.

ACTUALLY, I DON'T PARTICULARLY WANT TO DO IT, BUT I FEEL LIKE THE STATE'S SIGNALING.

YOU'RE GOING TO USE AI, YOU'RE GOING TO EMBRACE AI.

THERE'S GOING TO BE SOME RULES, BUT YOU'RE GOING TO DO IT. SO IF THAT'S THE CASE, THEN WHAT DO WE NEED TO DO TO PROTECT, YOU KNOW, WHAT DO WE NEED TO DO TO CONTROL. AND THEN WE CAN START FIGURING OUT HOW TO LEVERAGE IT BETTER.

I MEAN, WE YOU KNOW, CURRENTLY I SEE IT SHOWING UP IN THE TEAMS MEETINGS AND DOING AND DOING MINUTES.

YOU KNOW, I SEE IT DOING THAT. SO THAT SORT OF STUFF.

BUT YEAH, THIS IS MORE A REACTION TO THE STATE LAW THAT SEEMED TO BE SIGNALING YOU'RE GOING TO BE USING AI.

YOU'RE NOT GOING TO BE ABLE TO SAY YOU'RE NOT USING AI. SO FIGURE IT OUT.

SO THAT'S WHAT WE'RE TRYING TO DO. YEAH I AGREE WITH CITY MANAGER.

THERE'S THERE'S A CAUTIONARY TALE. BUT IT'S LIKE THAT IT'S BEING ALL IT'S ALL AROUND US.

WE'RE IN THIS ENVIRONMENT. SO IF WE JUST SAY WE'RE GOING TO BE, WE'RE NOT GOING TO EMBRACE IT, THEN WE'RE AT RISK OF EITHER OUTPACED OR OUTDONE OR, OR SOMETHING CRITICALLY NEGATIVE WHERE IT CAN BE DAMAGED BY THAT.

SO I THINK WE HAVE TO HAVE THAT INTERNAL UNDERSTANDING AND THEN GROW WITH IT.

BUT BABY STEPS. CITY PUBLIC FOLLOWING STATE AND THINGS LIKE THAT.

BUT OH, THE OTHER THING I WAS GOING TO ASK IS HOW DOES THIS AFFECT PD? IT IS THIS A IS THIS INCLUDE THEM BECAUSE WE'RE ALL ON THE SAME NETWORK.

IT'S NOT SEPARATED, AT LEAST NOT YET. SO THIS WOULD BE THE SAME THING WITH PD.

PD. HOW DO YOU HOW DO YOU FEEL ABOUT WE DIRECTED EVERYONE TO NOT USE AI FOR OFFENSE REPORTS.

OKAY. LOTS OF PERSONAL INFORMATION, LOTS OF CASE DETAILS AND WHATNOT.

SO WE'RE FORBIDDEN FROM USING IT ON CASE REPORTS DID NOT RESTRICT THEM FROM USING ANYTHING ELSE.

IT'S A MAJOR TIME SAVER IN A LOT OF WAYS. I KNOW A LOT OF OUR GUYS USE IT FOR PUTTING TOGETHER DIFFERENT PROJECTS WITHIN THE PD.

YOU KNOW, WE ALREADY HAVE QUITE A BIT OF LEEWAY ON SOME OF THE WEBSITES WE ACCESS BECAUSE THEY'RE NOT VERY FRIENDLY, SO TO SPEAK. WE TRY TO LIMIT THOSE WEBSITES THAT WE ACCESS TO A COUPLE MACHINES JUST IN CASE WE EVER HAVE TO LOOK AT SOMETHING OR INVESTIGATE SOMETHING ON OUR END.

BUT IT IT DOES GET USED A LOT. WE HAVE SEVERAL GUYS THAT USE IT ALL THE TIME USING ONLY ON ON THEIR, THEIR, THEIR CITY DEVICES OR ON THEIR PERSONAL DEVICES.

AND I CAN'T SAY FOR BOTH. YOU KNOW, MY PERSONAL PHONE IS ON CITY WI-FI.

IT'S BEEN ON CITY WI-FI FOR 25 YEARS, YOU KNOW.

YEAH. AND SO IT ALSO BRINGS THE POINT WHERE YOU HAVE ONE IT PERSON.

CORRECT. AND THEN HOW WHAT'S THE BURDEN ON IT FOR YOU KNOW, YOU KNOW THE HOURS USED NOT ONLY JUST THE CAPITAL COSTS AND SUBSCRIPTION COSTS BUT WHAT'S THE BURDEN ON ON IT PERSONNEL.

OKAY. ON WHAT TOOLS. WE WE GET THAT. I CAN DEFINITELY SAY WITHOUT BECAUSE DARWIN'S THE GATEKEEPER.

THAT'S WHAT IT IS. YEAH. SO WITHOUT THAT, THE OTHER ALTERNATIVE IS FOR PEOPLE TO BE MORE INVOLVED, REVIEWING LOGS AND ALL THAT SORT OF STUFF, YOU KNOW, AFTER THE FACT.

SO IF WE IF WE WANT TO TRY TO AUTOMATE A GATEKEEPER THAT CAN ADDRESS THINGS IN REAL TIME, THAT'S DARWIN. IF WE DON'T AND WE WANT TO REVIEW LOGS AFTER THE FACT, THAT'S THAT'S IT.

MANPOWER. WAS DARWIN BUILT FOR CIVIC SERVICE OR WAS IT OR IS THAT THE CIVIC PLUS? IT'S MAINLY BUILT FOR CIVIC SERVICE. SO JUST JUST TO COME OUT AGAIN BECAUSE FROM THE QUESTIONS, IT FEELS LIKE THERE'S A LITTLE BIT OF CONFUSION HERE.

DARWIN IS NOT A LARGE LANGUAGE MODEL. CORRECT.

[00:35:02]

IT'S IT'S JUST THE GATEKEEPER TO THE POLICIES.

RIGHT. SO IT WAS BUILT FOR MUNICIPALITIES SPECIFICALLY TO ENSURE THAT WE ARE NOT PUTTING OURSELVES AT GREATER RISK THAN WE SHOULD BE.

IT USES AI, BUT IT'S NOT THE CORRECT. YEAH. AND THEN CIVIC PLUS ITSELF, WHAT THAT DATA SET WOULD BE WOULD BE OUR WEBSITE.

SO THAT'S THAT'S YOUR STANDARD CHATBOT THAT THAT I'VE BEEN AROUND FOR TEN YEARS NOW.

THAT'S NOT THIS NEW AI PUSH THAT'S HAPPENING.

RIGHT. SO WE'RE ALREADY USING THE WE USE CIVIC PLUS TO HOST OUR WEBSITE.

WE DO NOT HAVE A CHATBOT ON THERE CURRENTLY. OH, THERE IS NO AI CHATBOT.

CORRECT. AND AND ARGUABLY THE THE THE DARWIN FOLKS CAME AROUND OVER A YEAR AGO.

WE TOLD THEM TO POUND SAND BECAUSE WE WEREN'T GOING TO BE USING AI, AND THEN THE STATE DID WHAT IT DID AND WE'RE LIKE, HEY, YOU MIND COMING BACK AND TALKING TO US AGAIN JUST REAL QUICK? SO AN EXAMPLE YOU'RE TALKING ABOUT PERSONNEL IS A LOT OF OUR SECURITY TOOLS DO HAVE SOME AI BUILT INTO THEM, RIGHT. AND IF THEY DON'T, THAT'S WHEN YOU TALK ABOUT IF WE ABSOLUTELY USE NONE, WE OPEN OURSELVES UP TO MORE LABOR, TO MORE LABOR. AND WE HAVE ONE SECURITY ADMINISTRATOR.

IF WE DIDN'T HAVE SOME AI BUILT IN OUR SECURITY TOOLS, WE'D HAVE TO HAVE TO HAVE A TEAM OF THEM.

YOU KNOW, RESISTANCE IS FUTILE. I THINK I KNOW THIS IS KIND OF A BUDGET OR MANPOWER, BUT ARE WE LOOKING AT INCREASING STAFF OR JUST FOR PD SINCE WE HAVE ONE PERSON THERE? I PROBABLY HAVE 1.5 FTE AND YOU'RE IN THIS BUILDING THAT WORK FOR PD ON THE PROJECTS AND STUFF.

SO I THINK AND I KNOW WE HAVE THE TOOLS TO MAKE THINGS EASIER, BUT IMPLEMENTATION, THE VETTING AND THE STANDARDS AND STUFF, YOU KNOW, I DON'T KNOW, I JUST. I WOULD WANT TO HAVE A LITTLE MORE IT.

HE HAS WON IT AND HE WORKS, YOU KNOW, 9 TO 5.

BUT HE DOES WORK. I THINK ONE DAY A WEEK WHERE HE, HE WORKED ON THOSE CARS ALL EVENING.

BECAUSE IF YOU HAVE AN IT ISSUE ON THE NIGHT SHIFT, THEY HAVE NO SUPPORT.

I KNOW AND THAT'S, THAT'S A PROBLEM TO ME. YEAH, THAT'S KIND OF THE ISSUE IS THAT HE'S EITHER GOT TO BE ON CALL OR.

YEAH. OR THEY JUST THEY'RE DOWN. RIGHT. RIGHT.

THEIR THEIR COMPUTERS DOWN, THEIR THEIR CARS DOWN.

AND THAT'S USUALLY WHAT HAPPENS. IF I WERE GOING TO ADD AN FTE IT WOULD BE A PD.

I AGREE. ANYWAY BUT SO WHAT'S THE ASK PER THE POLICY.

WAIT FOR THE STATE TO COME OUT WITH THEIR GUIDELINES BEFORE WE DO THE POLICY.

THIS IS JUST MORE LIKE INFORMATIVE, WHERE THEY'RE KIND OF LEANING UNTIL WE GET DIRECTION FROM THE STATE, BECAUSE I FEEL LIKE THE STATE PASSED A LAW.

BUT YOU'RE WAITING FOR. SO, SO IN THE POLICY, IT SAYS THAT THIS POLICY NEEDS TO BE IN ACCORDANCE WITH WHATEVER GUIDELINES THAT DER PUTS OUT. SO SO THAT WOULD BE IN ADDITION MOST OF THIS ON THE PURCHASING SIDE IS, IS OUR CURRENT PURCHASING REGULATIONS AND CERTIFICATIONS IS SOMETHING THAT WE DO ASK FOR WHEN WE, WHEN WE GET SOFTWARE'S. THAT'S NOT A NEW PROCESS FOR US.

SO THE, THE ASK REALLY WAS TO, TO GAUGE THE TEMPERATURE OF COUNCIL TODAY ON HOW MUCH THEY WANT TO INVEST IN THE ENFORCEMENT SIDE OF IT. BECAUSE ONCE DER HAS THOSE GUIDELINES, WE'RE, WE'RE REQUIRED TO HAVE AN AI POLICY.

SO SO THEN WHY CAN'T YOU JUST MATCH IT TO WHAT THEY HAVE, THE DER.

SO THIS WOULD JUST KIND OF BE A PLACEHOLDER. CORRECT.

I'M GOOD WITH THAT. I'LL MAKE A MOTION TO APPROVE THIS AS PRESENTED TO HELP US GET INVOLVED.

EVERYBODY READ IT RIGHT. WE GOT TO TALK. I NEVER GOT TO READ ANY OF MY, MY, MY INTENTION WAS TO BRING IT BACK TO AN OFFICIAL COUNCIL MEETING.

BUT SO HE'S, IS THERE A SECOND? I HAVE A MOTION TO TAKE.

HOLD ON, HOLD ON. OKAY. SORRY. THERE'S A MOTION TO APPROVE THIS AS PRESENTED.

I HAVE A SECOND FOR THAT. I'M SORRY. APPROVE THIS.

WHAT IS THIS? THE POLICY? OKAY. SORRY. NOT HEARING A SECOND.

THAT MOTION DIES. IF YOUR INTENTION WAS TO BRING IT BACK TO THE COUNCIL MEETING, I'D BE WILLING TO MAKE A MOTION TO REQUEST STAFF TO BRING THIS BACK TO A FUTURE COUNCIL MEETING.

HAVE YOU ANY MORE TIME TO WORK ON IT? LIKE THE NEXT MEETING IN SEPTEMBER OR OCTOBER? SEPTEMBER? OCTOBER? OKAY, SO FIRST MEETING IN OCTOBER TO BRING BACK THE POLICY THAT WE CAN REVIEW IN COUNCIL MEETING AND CONSIDER FOR APPROVAL.

I'LL SECOND THAT SO WE CAN DISCUSS IT. SO THIS DRAFT THIS IS WHAT YOU GUYS LIKE, RIGHT? SO SO WE CAN ACTUALLY SO WE COULD ACTUALLY DISCUSS THIS ON THE MESSAGE BOARD.

WE ALL HAVE A COPY. WE CAN REVIEW IT. AND SO WHEN YOU BRING IT BACK IN OCTOBER SAY THIS PASSES AND YOU BRING IT BACK IN OCTOBER, IT COULD ALMOST BE IN A CONSENT AGENDA IF WE LIKE IT.

OR WE CAN BRING IT FOR DISCUSSION, WHATEVER NEEDS TO HAPPEN. OKAY.

[00:40:04]

I WOULD JUST AMEND OUR FRIENDLY AMENDMENT. IS THAT SPECIFICALLY MAYBE THIS IS ALREADY IN THERE, BUT ADDRESS THE QUESTIONS THAT WE BROUGHT UP HERE IN THIS WORK SESSION.

I MEAN, LISTEN, THAT'S FINE. WHAT LAW SHOULD WE LOOK AT? THE LAW. YOU GUYS KNOW WHAT THAT LAW. YEAH. THAT IN THE POLICY.

YEAH. THERE'S 3 OR 4 OF THEM. HOUSE BILL 149.

ONE OF THEM. SO YOU GUYS YOU SEND IT, SEND IT TO US JUST DURING THE SECOND PAGE.

SECOND WHICH. OH THE THE POLICY, THE 35, 1212, 12.

1960 1964. IS THERE ANOTHER ONE? THERE'S A THIRD ONE THAT'S REPETITIVE AND MAINLY ABOUT TRAINING, BUT BUT I WILL SEND THAT TO YOU GUYS. THANK YOU.

YEAH. THANK YOU. IF YOU COULD DO AN AI SUMMARY OF THAT.

I WHISPERED THAT TO HIM, BY THE WAY, BEFORE Y'ALL CALLED.

BEFORE Y'ALL CALL THE VOTE. IS THERE AN OPPORTUNITY TO GET ADDITIONAL INDICATION IF Y'ALL ARE LEANING TOWARD OPTION ONE, TWO, OR THREE? I DON'T MIND THE NOTES, THE NOTE DEAL, AND I DON'T MIND THE WHAT'S THE MICROSOFT ONE CALLED? OH YEAH, I DON'T MIND THAT. BUT I DON'T LIKE IS PERSONALLY I DON'T LIKE THE CHATGPT.

I DON'T LIKE ALL THEM OTHER ONES. WELL, JUST WHAT WE'RE ASKING IS, DO YOU WANT US TO JUST FOCUS ON THE POLICY? POLICY GETS TO WHAT? OPTION TWO IS THE POLICY PLUS ENFORCEMENT.

THAT'S DARWIN. AND THEN OPTION THREE IS POLICY PLUS ENFORCEMENT PLUS THE INTERNAL CHATBOT.

WE HAVE TO HAVE THE DARWIN TO GET THE CHATBOT.

WE DO NOT. BUT DARWIN IS THE CONTROL. SO YOU CAN'T HAVE COPILOT WITHOUT DARWIN.

NO COPILOT IS MADE BY COPILOT. YOU CAN HAVE CHATGPT.

YOU CAN HAVE EVERY AI THERE IS. DARWIN IS IS WHAT WE'RE ASKING YOU GUYS TO CONSIDER AUTHORIZING TO CONTROL THE AI, RIGHT? IT'S ONLY GATEKEEPER, AS THEY SAY. IT'S THE CHECKS AND BALANCES. CHECKS AND BALANCES. I FEEL GOOD WITH OPTION THREE.

JUST BECAUSE YOU GOT YOU GOT EVERYTHING ALL IN ONE VERSUS TRYING TO PICK AND CHOOSE WITH.

BECAUSE THAT'S AT LEAST WHAT I'M UNDERSTANDING WITH OPTION TWO.

SO I WOULD BE COMFORTABLE WITH OPTION THREE. AND IF I HEARD RIGHT, IF WE DON'T DO DARWIN, THERE'S POTENTIALLY GOING TO BE AN ASK FOR MORE IT PERSONNEL BECAUSE PEOPLE WILL HAVE TO DO THAT PICK UP.

I WOULD ASSUME THAT THE WILD WILD WEST. YES. YEAH.

AND THAT'S EVEN IF YOU JUST KEEP THE THE THE MICROSOFT ONE.

THE COPILOT. WELL, IT'S BECAUSE THE POLICY HAS TO BE ENACTED AND HAS TO BE CHECKED.

SO IF WE HAVE A POLICY THAT SAYS, HEY, WE'RE ONLY GOING TO USE COPILOT, THEN THEY'RE STILL GOING TO HAVE TO BE LOGS TO CHECK AGAINST IF PEOPLE ARE USING SOMETHING OTHER THAN COPILOT. SO IT'S LIKE I MEAN, THAT'S WHAT I'M GETTING AT, IS THERE'S NO WAY TO SAY YOU CAN ONLY USE COPILOT AND EVERYTHING ELSE.

YOU'RE ABLE TO WALK TO WHERE THEY CAN'T EVEN GET ON, OR YOU'RE TELLING ME YOU CAN'T WALK. LIKE, IF THE POLICY IS YOU CAN'T, YOU CAN'T ACCESS ANY AI, THE COPILOT AND BLOCK OUT ALL THE ONES WE KNOW OF.

BUT SOUND SOUNDS LIKE YOU CAN'T JUMP IN THERE.

IT SOUNDS LIKE. BASED ON HIS PREVIOUS ANSWER WHEN I ASKED.

SO LAYER SEVEN FIREWALL. LAYER SEVEN DEVICE IS A IT'S AN APPLICATION, SO IT BLOCKS THE APPLICATION.

SO THAT WOULD BE LIKE IF SOMEONE GOT ON FACEBOOK AND THERE'S AN AI APPLICATION WITHIN FACEBOOK, IT WOULDN'T BLOCK FACEBOOK. IT WOULD BLOCK THE APPLICATION INSIDE OF FACEBOOK. WE DON'T HAVE THAT.

SO I DON'T KNOW THAT WE. CORRECT ME IF I'M SPEAKING OUT OF TURN.

I DON'T KNOW THAT WE COULD DO. WHAT YOU'RE SAYING IF WE DON'T HAVE SOMETHING LIKE AS ROBUST AS THAT.

BECAUSE. BECAUSE AI IS BUILT INTO SO MANY THINGS.

RIGHT. SO WE HAVE THAT ROBUST SYSTEM. DO WE NEED DARWIN? CAN COPILOT KEEP A LOG? AND INSTEAD OF DOING DARWIN AND PAYING.

20,000 IS A REAL THING IS WE NEED THE THE HIGHER.

AND THAT ONE'S GOING TO BE MORE EXPENSIVE AND MORE EXPENSIVE. IT WOULDN'T NECESSARILY IT WOULD BLOCK. IT WOULDN'T NECESSARILY TRACK SOMEBODY TRYING TO DO SOMETHING, SOMETHING NEW COULD COME OUT THAT THEY MAY BE USING THAT ISN'T BLOCKED YET.

THERE'S ALWAYS A LITTLE MORE YOU'D HAVE TO MANUALLY UPDATE IT, OR YOU HAVE TO SUBSCRIBE TO SOMETHING THAT WAS GOING TO UPDATE IT FOR YOU. SO YOU'RE PAYING EITHER WAY, RIGHT? YEAH, I'M PERSONALLY ME.

I'M GOING TO I'M GOING TO LEAN TO OPTION ONE. I THINK THAT'S PROBABLY NO SURPRISE TO ME SAYING THAT. BUT BECAUSE I THINK IT'S IT'S MORE ON, YOU KNOW, LET'S GET THE LET'S GET THE POLICY IN PLACE. LET'S SEE WHAT TEXAS COMES UP WITH.

AND KIND OF BABY STEP IT. I AGREE WITH WITH JIM IN IN THE FACT THAT WE'RE KIND OF IN THE MIDDLE OF THE EVOLUTION.

AND, YOU KNOW, I DON'T I DON'T WANT TO JUST JUMP IN AND SAY, HERE WE ARE.

BUT AT THE SAME TIME, I DON'T WANT TO SIT BACK AND GET CAUGHT WITH OUR PANTS DOWN.

SO I'M GOING TO LEAN TOWARDS OPTION ONE, BUT OPTION THREE IS A POSSIBILITY FOR ME IN THE FUTURE.

WITH MORE DISCUSSION AND POSSIBLY JUSTIFICATION.

BECAUSE. BECAUSE AI IS IN EVERYTHING AND I DON'T LIKE IT AT ALL, I HATE IT.

WHERE I WORK, THEY'RE ALLOWED TO USE IT, AND I THINK IT MAKES PEOPLE LAZY. IT DOES MAKE SOME PEOPLE EFFICIENT, BUT IT MAKES OTHER PEOPLE LAZY. IT DEPENDS ON THE PERSON. SO

[00:45:07]

THAT'S, YOU KNOW, GENERAL STATEMENT THERE, BUT I'M NOT A I'M NOT COMPLETELY OPPOSED TO OPTION 2 OR 3, BUT RIGHT NOW I'M GOING TO STICK WITH OPTION ONE BECAUSE I THINK WE NEED TO STEP INTO IT SLOWLY.

IT BRINGS UP A POINT HOW DO DO WE CAN WE MONITOR HOW DO WE MONITOR THE ACTIVITY THAT WHEN WE'RE USING AI TO SEE? IN OTHER WORDS, HOW ARE WE ABLE TO HAVE SOME FIGURE OF MERIT? THIS IS DOING SOMETHING GOOD FOR US LIKE WE'VE DONE.

WE'VE DONE ALL THESE MINUTE SUMMARY. WE'VE DONE ALL THESE MAYBE HR STUFF AS FAR AS YOU KNOW JOB DESCRIPTIONS OR, OR REQUIREMENTS THAT FOR. SO CAN WE HOW DO WE MONITOR WHEN WE, WHEN WE, IF WE, IF WE PICK, IF WE ALLOW COPILOT OR WHATEVER AI TOOL FOR OUR EMPLOYEES.

HOW DO WE MONITOR HOW THAT'S UTILIZED? IS THAT IS THERE A TOOL FOR THAT OR DOES SOMEONE HAVE TO GO IN AND LOOK AT THE LOGS? IF THERE'S LOGS? I WILL CONFIRM WITH DARWIN. BUT BUT I WOULD BELIEVE DARWIN.

OKAY. DARWIN. YES. OKAY. BECAUSE THAT'S GOOD TO ASK.

CHATGPT. CAN I PLEASE GET A LOG OF ALL THE DARWIN? WHAT IS MIKE DOING? I JUST PUT THAT IN. I WHAT I TOOK AWAY FROM FROM THIS IS THIS WAS MORE OF AN INFORMATIONAL TYPE OF MEETING.

THAT THERE'S STILL LAWS THAT THE STATE OF TEXAS IS LOOKING AT IMPLEMENTING.

WE STILL NEED TO GO THROUGH THIS POLICY, UNDERSTAND IT, AND DIGEST IT.

SO SOME OF THE STUFF THAT THAT I'M HEARING, WE'RE ALMOST KIND OF PUTTING THE CART BEFORE THE HORSE AND WE NEED TO TAKE IT FOR WHAT IT IS. I WOULD PROBABLY GO MORE WITH OPTION ONE.

BEFORE WE START SPENDING MONEY AND THEN THE STATE COMES, COMES OUT WITH, WITH CERTAIN LAWS, AND WE GOT TO SPEND MORE MONEY TO BE IN COMPLIANCE WITH THE STATE.

SO THAT'S THAT'S MY POSITION ON IT. I JUST NEED SOME MORE TIME WITH THAT BEFORE I'M READY TO DECIDE WHAT THE RIGHT PATH IS ON THE THREE OPTIONS.

I HAVE TO GO HOME AND USE AI TO READ SOME OF WHAT YOU GAVE US HERE.

I'M GOING TO SUMMARIZE THIS. I'M GOING TO OCR IT AND SUMMARIZE IT, AND THEN I'LL SEND IT TO YOU.

I'LL PUT IT IN THE TEAMS MESSAGE FOR YOU. I'LL SUMMARIZE YOUR SUMMARIZE.

THERE YOU GO. I'LL LET YOU DO THAT ON YOUR COMPUTER.

IT'S NOT ON MY PERSONAL COMPUTER. BY THE CITY OF HUTTO.

YOU KNOW,. CLICK THE WRONG BUTTON. OKAY, SO WE HAVE THE MOTION BY COUNCIL MEMBER GORDON AND SECONDED BY PORTERFIELD TO BRING BACK FIRST MEETING OCTOBER.

POLICY. SO DO ROLL CALL. COUNCIL MEMBER THOMPSON.

COUNCILMAN MORRIS. AYE. COUNCILMAN. GORDON. AYE.

PORTERFIELD. AYE. THAT'S MAKING A MAYOR PRO TEM THORNTON.

AYE. MAYOR. SNYDER. AYE. SEVEN ZERO. JAMES. SORRY WE RAN OUT OF TIME.

THAT'S OKAY. IT'S AN IMPORTANT TOPIC. I THOUGHT THIS WAS GOING TO BE LIKE A TEN MINUTE. EVERYBODY WOULD GET IT OVER MY HEAD, AND THEN WE COULD. THAT'S OKAY. SO WE'LL ADJOURN AT 6:48 P.M..

* This transcript was compiled from uncorrected Closed Captioning.