Managing data portal

This week ​@yier.wu  (Customer Support Specialist) and ​@frederic.passaniti (Solutions Architect) have broken down the biggest takeaways, limitations, and clever strategies discussed to keep your data publishing seamless. "Volume limits should never be an obstacle to publishing your datasets." — ​@Nicolas Terpolilli , Head of Product Delivery 📊 Understanding the limitsThe platform enforces three distinct types of technical limits based on how your datasets are ingested:1. Local file uploads (240 MB) The limit: applies to individual source files (CSV, JSON, XLSX, etc.) uploaded directly from your computer. Pro-tip: a single dataset can aggregate multiple sources, meaning you can combine multiple files that are each under 240 MB. 2. Remote connections (500 MB) The limit: applies to remote server data fetches via URLs, APIs, or data warehouse connectors (Snowflake, Databricks, Google Drive, etc.). Watch out: if an API response exceeds 500 MB, you'll receive a transfer error. This can

We are preparing to migrate from the old platform to the new experience. We've made recent changes to one of our existing custom pages (https://data.townofcary.org/page/storydirectory/) by updating HTML/CSS in the main content area between the navigation menu bar and the footer. Do we need to do anything now to ensure the current content on this page will display once we migrate to the new experience? (We have about 10 custom pages in the same situation.)

Here’s how to safely automate dormant-user clean-up with the Huwise Automation API.💡 Strategic recommendations before you startBefore running any deletion script, we recommend setting clear rules to avoid revoking legitimate access:Set a reasonable inactivity threshold: For a first clean-up, favor 12 to 24 months. A 90-day threshold can be too short for a data portal where some users only log in once or twice per year. Segment your user populations: You can be stricter (e.g., 90 days) for invitations that were never activated, while staying more flexible with long-standing users. Protect critical accounts: Always exclude from your filters administrators, editors (publishers), data managers (data stewards), and service/API accounts. Notify your users: Send a reactivation email about 30 days before the deadline. This is a best practice and may also be required under GDPR.🛠️ The automation workflow (best practices)We recommend a 5-step approach to ensure data safety:Extract: Retrieve th

Hi,Is it possible to make a user an “admin” of a certain group, or is there any the blanket permission to allow users to edit all groups?Essentially we are in a project with a 3rd party where we want them to be able to add users to a group that has bespoke permissions to certain datasets, but we dont want to give this 3rd party the ability to edit all the groups on the portal. So if we can let them just add users to their one group, that would be very useful! Thanks Ryan

Hello everyone! 👋We’re seeing more and more companies adopting Huwy to boost exploring the data of their Huwise portals. But we also know that many of you are true builders and experiment with your own internal solutions.We’d like to take the community’s pulse on this balance between “off-the-shelf” solutions and “homegrown” developments.📊 The surveyWhat is your current setup regarding AI agents?Full Huwy : we use Huwy intensively and it covers all our current needs. Hybrid : we use Huwy, but we have also developed specific internal agents/scripts for particular use cases. Exploration : we are testing Huwy, but have not yet rolled out major AI initiatives. DIY (Do It Yourself) : we do not use Huwy, we have built our own agents/automation on our side. Pending : no generative AI or agents on our immediate roadmap yet.💬 We want your opinion!Beyond the vote, share your experience in the comments:For Huwy users : what is the use case that saves you the most time? For internal agent creat

We are setting up a process to update the resources for our datasets using the Automation API. I am looking for best practice advice. Here is what we currently do, starting with a dataset_id and a file that we want to upload: Retrieve the dataset_uid using the endpoint /api/explore/v2.1/catalog/datasets/{dataset_id}. Retrieve the currently used resource_uid of the dataset using the endpoint /api/automation/v1.0/datasets/{dataset_uid}/resources, with the dataset_uid from step 1. Upload the file to the dataset using the endpoint /api/automation/v1.0/datasets/{dataset_uid}/resources/files, again using the dataset_uid from step 1. From the response I get the file_uid of the uploaded file. Update the dataset resource using the endpoint /api/automation/v1.0/datasets/{dataset_uid}/resources/{resource_uid}, with the dataset_uid from step 1, the resource_uid from step 2, and the file_uid from step 3. Republish the dataset using the endpoint /api/automation/v1.0/datasets/{dataset_uid}/pu

HiI’m working on accessibility fixes for a client who is using a portal theme.Apparently, many of the issues originate from the portal theme. So I would need to edit the HTML in many places, and in some cases even add JavaScript.Currently, I can’t find any way to change the HTML, and I saw in the documentation that adding JavaScript isn’t allowed for security reasons, which I understand.So I was looking into how I can contribute to the theme, but I can’t seem to find how to do that. That’s why I opened this topic.Thanks for the feedback.Matthias

We are evaluating our move to the marketplace experience and support have been wonderful in helping achieve some of our goals that we’ve always wanted.One, is to have a couple of feeds on the front page showing the latest datasets but also latest publications (a new asset category we have created).Supports suggestion was to setup a couple of new contexts fed from a dataset of datasets. Which weve done and got so far but realised a dataset of datasets is just that. datasets only. Not assets. Also looking at the API I cannot see a way to actually query the asset catalogue. Question is: Has anyone successfully implemented a feed of various assets powered by the catalogue itself and not having to maintain a separate dataset? Attached is my current code block that reads from a dataset of datasets and incorporates the suggestions from support. Although the refine.category doesnt work as dataset of datasets doesnt include anything but datasets and also no category. Also the Asset slug wont wo

Dear Support Team,we have received the following request from a user regarding dataset https://data.bs.ch/explore/dataset/100120/, which we would like to forward to you for further investigation.The user reports an inconsistency in the handling of the field vu_jahr: The field is defined as a date in the dataset schema. However, when exporting the dataset, the field appears to be delivered as a string. When querying the dataset via ODSQL (using a SELECT vu_jahr GROUP BY vu_jahr query), the result returns proper datetime values (e.g. 2011-01-01 00:00:00+00:00, etc.). This inconsistent behavior causes issues in the user’s synchronization process. While they have implemented a workaround on their side, they asked whether this could be fixed at the platform level.Example query used by the user:https://data.bs.ch/api/explore/v2.1/catalog/datasets/100120/exports/csv?lang=de&timezone=Europe%2FBerlin&use_labels=false&delimiter=%3B&select=vu_jahr&group_by=vu_jahrCould you

My dataportal has data for a number of Local Authorities in the UK. I want to use the Territory/Geographic filter (or some filter) so people can select the geography they are interested in i.e Birmingham, Coventry, Dudley etc.When I enable the territory filter it requires me to select a default location. But, there is no way to choose another of the locations within my datasets. Its my default or nothing. How can people navigate the catalogue for their chosen geography without having to hack the URL?

I have a page:https://cityobservatory.birmingham.gov.uk/explore/dataset/test-emergency-admissions-for-copd-icp-outcomes-framework-birmingham-and-solihull-wards/insightWhich has 4 filters on that I want t o affect the majority of the visuals. However, for the map I want this to ignore anything made to the 3rd filter “area_name” but respect all other filters. How can I achieve this?I have tried the following either as its own context or as part of the main one at the start of the page but it just wont listen<ods-dataset-context context="mapctx" mapctx-dataset="{{ ctx.dataset.datasetid }}" mapctx-parameters="{ 'refine.date'= ctx.parameters['refine.date'], 'refine.time_period_range'= ctx.parameters['refine.time_period_range'], 'refine.ethnicity'= ctx.parameters['refine.ethnicity'], 'refine.imd':'ALL' }"> 

I would like to garner some ideas on how y’all manage updating static, flat file datasets on a regular basis.Most of ours pull from the source via API. But a few require us every week/month/year to download a flat file from the source to then re-upload to our platform.At first I thought a simple calendar with what needs doing when would be a good idea. But, some datasets dont drop on a regular schedule or can be delayed. So if I have a calendar entry saying “Download X data today” and its not there. It doesnt get done and I forget that ive not actually done that. So I need some way to check it off.How do you all efficiently manage your flat file updates? What tools or methods do you use?

I do not see any limitations on the offset and limit parameters for the exports endpoint. However, when I make the following request:https://data.longbeach.gov/api/explore/v2.1/catalog/datasets/lbpd-ripa-data-annual/exports/csv?offset=1I get back a CSV file with only 2 rows and the 2nd row says: “Streaming interrupted due to the following error: Invalid value for sum of offset + limit API parameter: 83714 was found but <= 10000 is expected. (error_code: InvalidRESTParameterError)”I thought the 10000 limit for offset+limit only applied to the records input. Is that wrong?If it’s useful, I am able to retrieve the entire dataset at once:https://data.longbeach.gov/api/explore/v2.1/catalog/datasets/lbpd-ripa-data-annual/exports/csv?offset=0

Hello, I am trying to change the thickness of the line in one of my ods-charts. I saw in the documentation that I can use a custom css library to change the formatting (ods-chart: Custom CSS Library – Codelibrary).I added the class="large-chart-series" to my ods-chart and it worked well when I was running the website locally.However when I try to implement the changes in the code editor on the ODS portal I am getting an API error:Is using the custom css library depreciated?What else can I do do change the format of my charts?Below I am pasting the code for the ods-chart I was working on. Thanks for the help  <ods-chart class="large-chart-series" single-y-axis="true" single-y-axis-label="" display-legend="true" label-x="" scientific-display="false" align-month="true" class="no-bg" > <ods-chart-query context="eolienperiodique" field-x="timestamp"

Is there a limit to the number of characters in text columns? I have long texts in a column and these are cut off in the tooltip and in the table preview. Is there a solution so that the whole text is displayed?

HelloI want to publish a dataset that is in a ZIP format. The source is a URL that I don’t want to share for safety/server load reasons. Unfortunately, ODS unzip it automatically.I just want an other URL pointing toward the same zip file… is it possible?Thank you Auto-translation 🪄BonjourJe souhaite publier un jeu de données au format ZIP. La source est une URL que je ne souhaite pas partager pour des raisons de sécurité/charge du serveur. Malheureusement, ODS le décompresse automatiquement. Je souhaite simplement une autre URL pointant vers le même fichier zip… est-ce possible ? Merci 

Hi,we would like to use ODS API to implement CICD on the style sheet of our portal.We are waiting since severals years now for this feature to appear in automation, I guess it won’t happen.Anyway ODS made previously a GH repo with a snippet of how to use management api to update the style sheet :https://web.archive.org/web/20201013231909/https://github.com/opendatasoft/ods-portal-devkit#expandUnfortunatly this repo is now deleted and the files ont the repo are gone.Is anyone aware on how to use the management API for the domain_theme ?

When you include a map widget in a custom view for a dataset you may notice that the height is not optimal for screens. You can change this with the following css in the Custom View tab of Visualisations in the backoffice. Adjust the min-height value to suit. .odswidget-map {    height:-webkit-fill-available;    min-height: 600px;}.odswidget-map__map {    height: 100%;    min-height: 600px;}

Since you updated the backend and put the schema into a separate tab, I am only able to access the filter information through the explore api. Where in the new backend do I find the filter settings (in the web interface)? Also, and related, where are the facet settings in general?Regards,Renato

Hi how does I sort the facets. The button doesn’t work like I thought. when I push the UP button, nothing happenAuto-translation 🪄Bonjour, comment trier les facettes. Le bouton ne fonctionne pas comme je le pensais. Lorsque j'appuie sur le bouton UP, rien ne se passe

HiWhere do I find the documentation for opendatasoft? Right know, I would like to know how exactly RTP behaves. E.g. what happens when I push a dataset with data that is already present, that is updated, or with just a few updates?But I am more interested in where your documentation is located. I am looking for something similar as the Automation v1 API documentation: https://help.opendatasoft.com/apis/ods-automation-v1/. When I have similar problems in the future, I would like to know where to search for the solution instead of asking in the community each time I run into a problem. Best,RenatoAuto-translation 🪄BonjourOù puis-je trouver la documentation d'opendatasoft ? Je voudrais savoir comment se comporte exactement RTP. Par exemple, que se passe-t-il lorsque je transmets un ensemble de données contenant des données déjà présentes, mises à jour ou avec seulement quelques mises à jour ? Mais je suis plus intéressé par l'emplacement de votre documentation. Je recherche quelque chose

Icons I was using the Opendatasoft Chrome extension until now (it’s very helpful to get the datasets in use on a page, or to go directly to the backoffice of the page)But it’s not supported anymore: Is there a way to make it available again?Thanks in advanceAuto-translation 🪄Icônes J'utilisais jusqu'à présent l'extension Chrome d'Opendatasoft (très utile pour récupérer les jeux de données utilisés sur une page, ou pour accéder directement au backoffice de la page)Mais elle n'est plus supportée : existe-t-il un moyen de la rendre à nouveau disponible ? Merci d'avance

Hello,Opendatasoft allows a range of filters for dataset searches as such. Using UKPN's data portal as an example:some 33kV results at the beginning. However, it omits datasets that actually contain the search term - such as “33kV” in my example - is there a filter that closely matches best fit? Such that “33kV” results show first? If not, can this be requested as a feature please?   33kV result at the end! Auto-translation 🪄Bonjour, Opendatasoft permet une gamme de filtres pour les recherches d'ensembles de données en tant que tels. En utilisant le portail de données d'UKPN comme exemple : certains résultats 33 kV au début. Cependant, il omet les ensembles de données qui contiennent réellement le terme de recherche - comme « 33 kV » dans mon exemple - existe-t-il un filtre qui correspond étroitement au meilleur ajustement ? De telle sorte que les résultats « 33 kV » s'affichent en premier ? Si ce n'est pas le cas, peut-on demander cela en tant que fonctionnalité ?  ...

Hello dear community,Could we make the SSO feature more prominent?Many employees don’t realize that they can use their existing government account to sign in.Currently, it looks like this: But we were thinking about something like that: Best regards,BorisAuto-translation 🪄Bonjour chère communauté,Pourrions-nous rendre la fonctionnalité SSO plus visible ?De nombreux employés ne savent pas qu'ils peuvent utiliser leur compte gouvernemental existant pour se connecter.Actuellement, cela ressemble à ceci : Mais nous pensions à quelque chose comme ça : Cordialement,Boris