{"id":768,"date":"2023-01-12T19:00:37","date_gmt":"2023-01-12T19:00:37","guid":{"rendered":"https:\/\/webresources-uat.com\/nchrp1918\/?page_id=768"},"modified":"2023-01-12T19:00:37","modified_gmt":"2023-01-12T19:00:37","slug":"33-determine-evaluation-metrics","status":"publish","type":"page","link":"https:\/\/crp.trb.org\/nchrpwebresource2\/setup\/33-determine-evaluation-metrics\/","title":{"rendered":"(33) Determine Evaluation Metrics"},"content":{"rendered":"\n<div class=\"ruc-block\" style=\"border-radius: 25px;border: 3px solid #5D93C2;margin: 30px;padding: 20px\">\n    <div class=\"container-contents\" style=\"margin-left: 25px;padding-left: 10px;margin-right: 25px\">\n      <div id=\"bbDIV\" style=\"min-width:45ch;max-width: 150ch;padding-right: 20px;margin-bottom: 25px;margin-top: 12px\"> \n          <div class=\"ruc-bb-head\" style=\"color: #818386;flex-wrap: wrap;width: 100%\"><a class=\"bb-headinks\" style=\"color: #818386;font-weight: 600\" href=\"..\/research-and-planning-overview\/\">RESEARCH&nbsp;AND&nbsp;PLANNING<\/a>&nbsp;&nbsp;|&nbsp;&nbsp;&nbsp;<span class=\"ruc-blue\" style=\"color: #5D93C2;font-weight: 800\"><a style=\"color: #5D93C2;font-weight: 800\" href=\"..\/\">SETUP<\/a><\/span>&nbsp;&nbsp;|&nbsp;&nbsp;  <a class=\"bb-headinks\" style=\"color: #818386;font-weight: 600\" href=\"..\/ongoing-operations\/\">ONGOING&nbsp;OPERATIONS<\/a>&nbsp;&nbsp;|    <a class=\"bb-headinks\" style=\"color: #818386;font-weight: 600\" href=\"..\/transitioning-growing-stage\/\">TRANSITIONING&nbsp;AND&nbsp;GROWING<\/a><\/div><\/div> \n  <div class=\"description-text\">\n  <h1> Determine Evaluation Metrics (33)<\/h1>\n  <h3><strong>Description:<\/strong><\/h3> \n  <p>      <!-- ####  ICON LINK #### -->\n    <img decoding=\"async\" src=\"..\/..\/wp-content\/uploads\/sites\/31\/2023\/08\/icons_Determine-evaluation-metrics-.png\" class=\"img-fluid\" style=\"float: right;width: 125px;height: 125px;margin-right: 1em;margin-left: 16px\">\n    <!-- ####  END ICON LINK #### --><\/p><p>\nDevelop metrics in parallel with system requirement specifications and the interface control document because those documents will specify data reported by the vendor and the ability to record data. Although state systems also record state data and compute metrics, those data may not appear in the interface control document, since it is internal to the state system. Vendor data must be reported to the state on a regular basis. Determine the reporting period for this data; reporting each month is often desirable, but some metrics can be generated more frequently. \n  <\/p>\n  <hr class=\"rounded-green\" style=\"border-top: 4px solid #5D93C2;border-radius: 5px\">\n  \n  <div class=\"details\">\n      <h3><strong>Details:<\/strong><\/h3>\n      <p>This building block determines system performance metrics and customer service\/service-level agreement metrics. System performance metrics include, at a minimum, the following:<\/p> <ul class=\"lorem\" style=\"margin-left: 30px\">\n<li>Dollars charged (total, by vehicle weight type, and by individual vehicle\/vehicle identification number)<\/li>\n<li>Dollars collected, which may differ from dollars charged<\/li>\n<li>Miles driven (total and by individual vehicle\/vehicle identification number)<\/li>\n<li>Count of enrolled vehicles<\/li>\n<li>Count of active vehicles (i.e., vehicles that are enrolled and are actively reporting mileage)<\/li>\n<li>Estimated or measured fuel consumed (only if fuel tax credits or refunds are offered)<\/li> \n<li>Average vehicle fuel economy in  miles per gallon (computed by dividing miles driven by fuel consumed for the appropriate vehicles)<\/li>\n<li>Any error metrics available<\/li><\/ul>\n<p>Customer service metrics include, at a minimum:<\/p>\n<ul class=\"lorem\" style=\"margin-left: 30px\">\n<li>Number of contacts per reporting period<\/li>\n<li>Average wait time<\/li>\n<li>Number of dropped calls<\/li>\n<li>Number of emails per topic <\/li><\/ul>\n      <p><\/p>\n  <\/div>\n  <hr class=\"rounded-green\" style=\"border-top: 4px solid #5D93C2;border-radius: 5px\">\n  <div class=\"primary-uses\">\n      <h3><strong>Primary Use:<\/strong><\/h3>\n      <p>Determine how the system\u2019s performance can be measured.\n      <\/p>\n  <\/div>\n  \n  <hr class=\"rounded-green\" style=\"border-top: 4px solid #5D93C2;border-radius: 5px\">\n  \n  <div class=\"primary-uses\">\n      <h3><strong>Best Practices\/Lessons Learned:<\/strong><\/h3>\n  <ul class=\"lorem\" style=\"margin-left: 30px\">\n      <li>Have many metrics; measure the system in as many ways as possible to get the greatest number of insights.<\/li>\n<li>Have new, specific metrics for unique system features; anything unique should be measured.<\/li>\n<li>Record metric values each reporting period, and research any unusual trends that occur.<\/li>\n  <\/ul>\n  <\/div>\n  <hr class=\"rounded-green\" style=\"border-top: 4px solid #5D93C2;border-radius: 5px\">\n  <div class=\"primary-uses\">\n      <h3><strong>State Government Context and Assumptions <\/strong><\/h3>\n      <p>The implementing RUC agency completes this task with consulting support in parallel with the development of system requirements and interface control documents. \n      <\/p>\n     <\/div>\n    <\/div>\n   <\/div>\n  <\/div>\n","protected":false},"excerpt":{"rendered":"<p>RESEARCH&nbsp;AND&nbsp;PLANNING&nbsp;&nbsp;|&nbsp;&nbsp;&nbsp;SETUP&nbsp;&nbsp;|&nbsp;&nbsp; ONGOING&nbsp;OPERATIONS&nbsp;&nbsp;| TRANSITIONING&nbsp;AND&nbsp;GROWING Determine Evaluation Metrics (33) Description: Develop metrics in parallel with system requirement specifications and the interface control document because those documents will specify data reported by the vendor and the ability to record data. Although state systems also record state data and compute metrics, those data may not appear in the interface &hellip; <a href=\"https:\/\/crp.trb.org\/nchrpwebresource2\/setup\/33-determine-evaluation-metrics\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;(33) Determine Evaluation Metrics&#8221;<\/span><\/a><\/p>\n","protected":false},"author":95,"featured_media":0,"parent":220,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"_acf_changed":false,"footnotes":""},"categories":[2,10],"tags":[],"class_list":["post-768","page","type-page","status-publish","hentry","category-building-blocks","category-setup-building-blocks"],"acf":[],"_links":{"self":[{"href":"https:\/\/crp.trb.org\/nchrpwebresource2\/wp-json\/wp\/v2\/pages\/768","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/crp.trb.org\/nchrpwebresource2\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/crp.trb.org\/nchrpwebresource2\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/crp.trb.org\/nchrpwebresource2\/wp-json\/wp\/v2\/users\/95"}],"replies":[{"embeddable":true,"href":"https:\/\/crp.trb.org\/nchrpwebresource2\/wp-json\/wp\/v2\/comments?post=768"}],"version-history":[{"count":0,"href":"https:\/\/crp.trb.org\/nchrpwebresource2\/wp-json\/wp\/v2\/pages\/768\/revisions"}],"up":[{"embeddable":true,"href":"https:\/\/crp.trb.org\/nchrpwebresource2\/wp-json\/wp\/v2\/pages\/220"}],"wp:attachment":[{"href":"https:\/\/crp.trb.org\/nchrpwebresource2\/wp-json\/wp\/v2\/media?parent=768"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/crp.trb.org\/nchrpwebresource2\/wp-json\/wp\/v2\/categories?post=768"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/crp.trb.org\/nchrpwebresource2\/wp-json\/wp\/v2\/tags?post=768"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}