{"id":4869,"date":"2024-02-13T15:12:46","date_gmt":"2024-02-13T15:12:46","guid":{"rendered":"https:\/\/blogs.gov.scot\/digital\/?p=4869"},"modified":"2024-02-14T13:53:29","modified_gmt":"2024-02-14T13:53:29","slug":"uncovering-trends-in-text-through-the-data-science-accelerator","status":"publish","type":"post","link":"https:\/\/blogs.gov.scot\/digital\/2024\/02\/13\/uncovering-trends-in-text-through-the-data-science-accelerator\/","title":{"rendered":"Uncovering trends in text through the Data Science Accelerator"},"content":{"rendered":"\r\n
\"\"<\/a>

Michael Shaw, Scottish Legal Complaints Commission<\/p><\/div>\r\n

Guest blog post by Michael Shaw, Scottish Legal Complaints Commission.<\/strong>

As a public sector data analyst, it\u2019s frustrating when you think you\u2019ve got a good idea to solve a business problem, but don\u2019t have enough time or technical support to explore it fully. That was certainly the case for me when it came to trying to unlock a particular issue for my organisation.<\/p>\r\n

Every year over 1000 people make a complaint about a lawyer to the Scottish Legal Complaints Commission. While some structured data is captured on these complaints in our case management system, lots of it is only available in Word or PDF documents attached to the record. That means valuable information and trend data is locked away in these files with no systematic way of exploring their content.<\/p>\r\n

I\u2019d been trying to do text analysis in R to understand what was held in these files but could only devote a small amount of time to this problem which meant any progress was limited. However the opportunity to apply for the Data Science Accelerator handed me the key I needed.<\/p>\r\n

We developed an accelerator project proposal to find methods to extract data from these documents and potentially identifying categories within the information they held. The application was accepted and by September 2023 the project was underway.<\/p>\r\n

As part of the accelerator programme, you\u2019re paired with a mentor. In my case I got the chance to be mentored by the amazing Reema Vadoliya of People of Data. It was my first time as a mentee and Reema was an incredible mentor who brought great experience from her data engineering background. Reema and I met weekly throughout the 12 week (really 1 day a week for 12 weeks) programme. We started by planning, drawing out the steps that I needed to do and highlighting unknowns.<\/p>\r\n

Pragmatism is one of the things I learned from being in the accelerator. While I had set my sights on developing a universe of text data, I realised pretty quickly that I had to quell my ambition and instead have a more realistic target for the project. What that translated to, working with Reema and my manager is that we would have at the end some repeatable, commented and documented code which could be a starting point for future work, ultimately sharing learning from complaints back to the legal profession.<\/p>\r\n

The accelerator programme wrapped up in December 2023 and we are going into 2024 with a toolkit that we can use to access and analyse text data \u2013 something that was previously beyond our reach.<\/p>\r\n

As well as the things I learned from the technical work itself, I gained experience of managing an innovation project and how to present complex ideas in a way that was easy to understand. I also learned a lot from the weekly meetings with the rest of the accelerator cohort. I would strongly recommend the Data Science Accelerator experience to other public sector data analysts when applications open in Spring 2024.

If Michael\u2019s blog post has inspired you, you can now apply for the 2024 Data Science Accelerator programme on the Scottish Digital Academy\u2019s website<\/a>. We look forward to hearing your ideas!<\/p>\r\n","protected":false},"excerpt":{"rendered":"

As a public sector data analyst, it\u2019s frustrating when you think you\u2019ve got a good idea to solve a business problem, but don\u2019t have enough time or technical support to explore it fully. That was certainly the case for me when it came to trying to unlock a particular issue for my organisation.<\/p>\n","protected":false},"author":317,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[18,6],"tags":[328,410,409],"class_list":["post-4869","post","type-post","status-publish","format-standard","hentry","category-data","category-digital-scotland","tag-data-science-accelerator","tag-public-sector-data","tag-scottish-legal-complaints-commission"],"yoast_head":"\nUncovering trends in text through the Data Science Accelerator - Digital<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/blogs.gov.scot\/digital\/2024\/02\/13\/uncovering-trends-in-text-through-the-data-science-accelerator\/\" \/>\n<meta property=\"og:locale\" content=\"en_GB\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Uncovering trends in text through the Data Science Accelerator - Digital\" \/>\n<meta property=\"og:description\" content=\"As a public sector data analyst, it\u2019s frustrating when you think you\u2019ve got a good idea to solve a business problem, but don\u2019t have enough time or technical support to explore it fully. That was certainly the case for me when it came to trying to unlock a particular issue for my organisation.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/blogs.gov.scot\/digital\/2024\/02\/13\/uncovering-trends-in-text-through-the-data-science-accelerator\/\" \/>\n<meta property=\"og:site_name\" content=\"Digital\" \/>\n<meta property=\"article:published_time\" content=\"2024-02-13T15:12:46+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-02-14T13:53:29+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/blogs.gov.scot\/digital\/wp-content\/uploads\/sites\/5\/2024\/02\/Data-Science-Accelerator-Michael-Shaw-Headshot-225x300.jpg\" \/>\n<meta name=\"author\" content=\"Stewart Hamilton\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Stewart Hamilton\" \/>\n\t<meta name=\"twitter:label2\" content=\"Estimated reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/blogs.gov.scot\/digital\/2024\/02\/13\/uncovering-trends-in-text-through-the-data-science-accelerator\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/blogs.gov.scot\/digital\/2024\/02\/13\/uncovering-trends-in-text-through-the-data-science-accelerator\/\"},\"author\":{\"name\":\"Stewart Hamilton\",\"@id\":\"https:\/\/blogs.gov.scot\/digital\/#\/schema\/person\/fd47935c780321ad6c4ecbb2f10da552\"},\"headline\":\"Uncovering trends in text through the Data Science Accelerator\",\"datePublished\":\"2024-02-13T15:12:46+00:00\",\"dateModified\":\"2024-02-14T13:53:29+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/blogs.gov.scot\/digital\/2024\/02\/13\/uncovering-trends-in-text-through-the-data-science-accelerator\/\"},\"wordCount\":550,\"commentCount\":0,\"image\":{\"@id\":\"https:\/\/blogs.gov.scot\/digital\/2024\/02\/13\/uncovering-trends-in-text-through-the-data-science-accelerator\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/blogs.gov.scot\/digital\/wp-content\/uploads\/sites\/5\/2024\/02\/Data-Science-Accelerator-Michael-Shaw-Headshot-225x300.jpg\",\"keywords\":[\"Data Science Accelerator\",\"public sector data\",\"Scottish Legal Complaints Commission\"],\"articleSection\":[\"Data\",\"Digital Scotland\"],\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/blogs.gov.scot\/digital\/2024\/02\/13\/uncovering-trends-in-text-through-the-data-science-accelerator\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/blogs.gov.scot\/digital\/2024\/02\/13\/uncovering-trends-in-text-through-the-data-science-accelerator\/\",\"url\":\"https:\/\/blogs.gov.scot\/digital\/2024\/02\/13\/uncovering-trends-in-text-through-the-data-science-accelerator\/\",\"name\":\"Uncovering trends in text through the Data Science Accelerator - Digital\",\"isPartOf\":{\"@id\":\"https:\/\/blogs.gov.scot\/digital\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/blogs.gov.scot\/digital\/2024\/02\/13\/uncovering-trends-in-text-through-the-data-science-accelerator\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/blogs.gov.scot\/digital\/2024\/02\/13\/uncovering-trends-in-text-through-the-data-science-accelerator\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/blogs.gov.scot\/digital\/wp-content\/uploads\/sites\/5\/2024\/02\/Data-Science-Accelerator-Michael-Shaw-Headshot-225x300.jpg\",\"datePublished\":\"2024-02-13T15:12:46+00:00\",\"dateModified\":\"2024-02-14T13:53:29+00:00\",\"author\":{\"@id\":\"https:\/\/blogs.gov.scot\/digital\/#\/schema\/person\/fd47935c780321ad6c4ecbb2f10da552\"},\"breadcrumb\":{\"@id\":\"https:\/\/blogs.gov.scot\/digital\/2024\/02\/13\/uncovering-trends-in-text-through-the-data-science-accelerator\/#breadcrumb\"},\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/blogs.gov.scot\/digital\/2024\/02\/13\/uncovering-trends-in-text-through-the-data-science-accelerator\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\/\/blogs.gov.scot\/digital\/2024\/02\/13\/uncovering-trends-in-text-through-the-data-science-accelerator\/#primaryimage\",\"url\":\"https:\/\/blogs.gov.scot\/digital\/wp-content\/uploads\/sites\/5\/2024\/02\/Data-Science-Accelerator-Michael-Shaw-Headshot.jpg\",\"contentUrl\":\"https:\/\/blogs.gov.scot\/digital\/wp-content\/uploads\/sites\/5\/2024\/02\/Data-Science-Accelerator-Michael-Shaw-Headshot.jpg\",\"width\":664,\"height\":885},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/blogs.gov.scot\/digital\/2024\/02\/13\/uncovering-trends-in-text-through-the-data-science-accelerator\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/blogs.gov.scot\/digital\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Uncovering trends in text through the Data Science Accelerator\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/blogs.gov.scot\/digital\/#website\",\"url\":\"https:\/\/blogs.gov.scot\/digital\/\",\"name\":\"Digital\",\"description\":\"Updates from the Scottish Government's Digital Directorate\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/blogs.gov.scot\/digital\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-GB\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/blogs.gov.scot\/digital\/#\/schema\/person\/fd47935c780321ad6c4ecbb2f10da552\",\"name\":\"Stewart Hamilton\",\"description\":\"Communications and Engagement Officer\",\"url\":\"https:\/\/blogs.gov.scot\/digital\/author\/stewarthamilton\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Uncovering trends in text through the Data Science Accelerator - Digital","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/blogs.gov.scot\/digital\/2024\/02\/13\/uncovering-trends-in-text-through-the-data-science-accelerator\/","og_locale":"en_GB","og_type":"article","og_title":"Uncovering trends in text through the Data Science Accelerator - Digital","og_description":"As a public sector data analyst, it\u2019s frustrating when you think you\u2019ve got a good idea to solve a business problem, but don\u2019t have enough time or technical support to explore it fully. That was certainly the case for me when it came to trying to unlock a particular issue for my organisation.","og_url":"https:\/\/blogs.gov.scot\/digital\/2024\/02\/13\/uncovering-trends-in-text-through-the-data-science-accelerator\/","og_site_name":"Digital","article_published_time":"2024-02-13T15:12:46+00:00","article_modified_time":"2024-02-14T13:53:29+00:00","og_image":[{"url":"https:\/\/blogs.gov.scot\/digital\/wp-content\/uploads\/sites\/5\/2024\/02\/Data-Science-Accelerator-Michael-Shaw-Headshot-225x300.jpg","type":"","width":"","height":""}],"author":"Stewart Hamilton","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Stewart Hamilton","Estimated reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/blogs.gov.scot\/digital\/2024\/02\/13\/uncovering-trends-in-text-through-the-data-science-accelerator\/#article","isPartOf":{"@id":"https:\/\/blogs.gov.scot\/digital\/2024\/02\/13\/uncovering-trends-in-text-through-the-data-science-accelerator\/"},"author":{"name":"Stewart Hamilton","@id":"https:\/\/blogs.gov.scot\/digital\/#\/schema\/person\/fd47935c780321ad6c4ecbb2f10da552"},"headline":"Uncovering trends in text through the Data Science Accelerator","datePublished":"2024-02-13T15:12:46+00:00","dateModified":"2024-02-14T13:53:29+00:00","mainEntityOfPage":{"@id":"https:\/\/blogs.gov.scot\/digital\/2024\/02\/13\/uncovering-trends-in-text-through-the-data-science-accelerator\/"},"wordCount":550,"commentCount":0,"image":{"@id":"https:\/\/blogs.gov.scot\/digital\/2024\/02\/13\/uncovering-trends-in-text-through-the-data-science-accelerator\/#primaryimage"},"thumbnailUrl":"https:\/\/blogs.gov.scot\/digital\/wp-content\/uploads\/sites\/5\/2024\/02\/Data-Science-Accelerator-Michael-Shaw-Headshot-225x300.jpg","keywords":["Data Science Accelerator","public sector data","Scottish Legal Complaints Commission"],"articleSection":["Data","Digital Scotland"],"inLanguage":"en-GB","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/blogs.gov.scot\/digital\/2024\/02\/13\/uncovering-trends-in-text-through-the-data-science-accelerator\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/blogs.gov.scot\/digital\/2024\/02\/13\/uncovering-trends-in-text-through-the-data-science-accelerator\/","url":"https:\/\/blogs.gov.scot\/digital\/2024\/02\/13\/uncovering-trends-in-text-through-the-data-science-accelerator\/","name":"Uncovering trends in text through the Data Science Accelerator - Digital","isPartOf":{"@id":"https:\/\/blogs.gov.scot\/digital\/#website"},"primaryImageOfPage":{"@id":"https:\/\/blogs.gov.scot\/digital\/2024\/02\/13\/uncovering-trends-in-text-through-the-data-science-accelerator\/#primaryimage"},"image":{"@id":"https:\/\/blogs.gov.scot\/digital\/2024\/02\/13\/uncovering-trends-in-text-through-the-data-science-accelerator\/#primaryimage"},"thumbnailUrl":"https:\/\/blogs.gov.scot\/digital\/wp-content\/uploads\/sites\/5\/2024\/02\/Data-Science-Accelerator-Michael-Shaw-Headshot-225x300.jpg","datePublished":"2024-02-13T15:12:46+00:00","dateModified":"2024-02-14T13:53:29+00:00","author":{"@id":"https:\/\/blogs.gov.scot\/digital\/#\/schema\/person\/fd47935c780321ad6c4ecbb2f10da552"},"breadcrumb":{"@id":"https:\/\/blogs.gov.scot\/digital\/2024\/02\/13\/uncovering-trends-in-text-through-the-data-science-accelerator\/#breadcrumb"},"inLanguage":"en-GB","potentialAction":[{"@type":"ReadAction","target":["https:\/\/blogs.gov.scot\/digital\/2024\/02\/13\/uncovering-trends-in-text-through-the-data-science-accelerator\/"]}]},{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/blogs.gov.scot\/digital\/2024\/02\/13\/uncovering-trends-in-text-through-the-data-science-accelerator\/#primaryimage","url":"https:\/\/blogs.gov.scot\/digital\/wp-content\/uploads\/sites\/5\/2024\/02\/Data-Science-Accelerator-Michael-Shaw-Headshot.jpg","contentUrl":"https:\/\/blogs.gov.scot\/digital\/wp-content\/uploads\/sites\/5\/2024\/02\/Data-Science-Accelerator-Michael-Shaw-Headshot.jpg","width":664,"height":885},{"@type":"BreadcrumbList","@id":"https:\/\/blogs.gov.scot\/digital\/2024\/02\/13\/uncovering-trends-in-text-through-the-data-science-accelerator\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/blogs.gov.scot\/digital\/"},{"@type":"ListItem","position":2,"name":"Uncovering trends in text through the Data Science Accelerator"}]},{"@type":"WebSite","@id":"https:\/\/blogs.gov.scot\/digital\/#website","url":"https:\/\/blogs.gov.scot\/digital\/","name":"Digital","description":"Updates from the Scottish Government's Digital Directorate","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/blogs.gov.scot\/digital\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-GB"},{"@type":"Person","@id":"https:\/\/blogs.gov.scot\/digital\/#\/schema\/person\/fd47935c780321ad6c4ecbb2f10da552","name":"Stewart Hamilton","description":"Communications and Engagement Officer","url":"https:\/\/blogs.gov.scot\/digital\/author\/stewarthamilton\/"}]}},"_links":{"self":[{"href":"https:\/\/blogs.gov.scot\/digital\/wp-json\/wp\/v2\/posts\/4869","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.gov.scot\/digital\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.gov.scot\/digital\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.gov.scot\/digital\/wp-json\/wp\/v2\/users\/317"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.gov.scot\/digital\/wp-json\/wp\/v2\/comments?post=4869"}],"version-history":[{"count":0,"href":"https:\/\/blogs.gov.scot\/digital\/wp-json\/wp\/v2\/posts\/4869\/revisions"}],"wp:attachment":[{"href":"https:\/\/blogs.gov.scot\/digital\/wp-json\/wp\/v2\/media?parent=4869"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.gov.scot\/digital\/wp-json\/wp\/v2\/categories?post=4869"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.gov.scot\/digital\/wp-json\/wp\/v2\/tags?post=4869"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}