Commit Graph

297 Commits

Author SHA1 Message Date
Chris Chinchilla
91072db7b5 docs: Add documentation label to troubleshooting sync workflow (#41939)
Add documentation label to troubleshooting sync workflow
2026-01-16 15:24:25 +07:00
Charis
30673a3644 ci(studio): use app token for ratchet decrease workflow (#41799)
We're using the default GITHUB_TOKEN to create the ratchet baseline
decrease PR. By default, this does not auto-run the PR checks to prevent
infinite loops.

Switching to a GitHub App token instead so the PR checks will auto-run.
2026-01-08 12:43:26 -05:00
Ivan Vasilov
b7bac67075 fix: Use head_commit_sha in authorize-vercel-deploys.yml action (#41795)
* Use head commit sha in the authorize-vercel-deploys.yml.

* Add comments.
2026-01-08 16:33:14 +01:00
Ivan Vasilov
d59711effd fix: Fix the trigger workflow name for the approve-vercel-deploys action (#41791)
Fix the wrong name of the GH workflow.
2026-01-08 14:27:30 +01:00
Ivan Vasilov
6f24342b55 fix: Change the authorize-vercel-builds to be triggered by another action (#41789)
Refactor the authorize-vercel-builds to run triggered by another action in order to access secrets.
2026-01-08 14:15:38 +01:00
Ivan Vasilov
cdadd74c9b feat: Add GH workflow for authorizing Vercel deploys (#41717)
* Add a script and call it from a GH action.

* Minor updates.

* Minor fixes.
2026-01-08 12:11:05 +01:00
Katerina Skroumpelou
8c367d0c86 ci: use github app generated token (#41767)
* ci: use github app generated token

* ci: pin action to commit sha
2026-01-07 13:27:04 +00:00
Matt Rossman
072883bcec feat: assistant evals (#41311)
* chore: bump `supabase` CLI

* chore: stricter message types in `generate-v4.ts`

* feat: tutorial eval

https://www.braintrust.dev/docs/evaluation

* feat: project ID for eval

* refactor: `generateAssistantResponse` out of `handlePost`

* refactor: generateAssistantResponse to lib/ai

* feat: factuality eval with assistant response

* chore: upgrade braintrust to v1.0.1

* chore: silence tsconfig warning

* feat: assertion scorer

* fix: aggregate tools across all steps

* refactor: strict tool names, remove need for `as const`

* refactor: generic tool name type in assertions

* feat: transfer mocks from `feature/braintrust`

* feat: LLM criteria assertion

* feat: braintrust evals workflow

* fix: BRAINTRUST_PROJECT_ID

* feat: `sql_similar` assertion

* fix: `OPENAI_API_KEY` in workflow env

* feat: split AssertionScorer into separate scorers

* feat: remove tutorial eval

* feat: 20 minute CI timeout

* feat: category in test case metadata

* feat: score with gpt-5

* refactor: dataset to own file, colocate scorers

* feat: "gpt-5.2-2025-12-11" for llm as a judge

* feat: SQL syntax scorer with `libpg-query`

* feat: `evals:setup` and `evals:run` scripts

* feat: `evals:setup` in CI

* feat: human readable scorer names

* chore: rename to "SQL Validity"

* feat: add 2 "sql_generation" test cases

* feat: update requiredTools in test cases

* chore: ignore Cursor MCP config

* feat: "Conciseness" score

* feat: "Completeness" scorer

* fix: generate-v4 test mocks

* feat: serialize "steps" for scorer inputs

* updated node mem options for typecheck

* updated runner

* remove ram update as actions handle this

* feat: read `BRAINTRUST_PROJECT_ID` from secrets

* feat: score helpfulness, remove old scorers

* feat: separate `evals:run` and `evals:upload` scripts

* feat: passthrough entire classifier result

* feat: use live `search_docs` impl, store docs result in metadata

* feat: reduce classifier options

* feat: filter workflow by `run-evals` PR label or `master` branch

* chore: cleanup stubbed mock tools

* fix: checkout actual branch with `ref:`

* fix: capture search_docs results from all content parts

* feat: simplify sql syntax score calculation

* feat: use AI SDK's UI message validator

* docs: justification for relative `extends`

* fix: cleanup leftover validatedMessages

* doc: note mock token isn't secret for snyk

* fix: mock ui message to pass validation

* feat: revert ignoring Cursor MCP config

Using `.git/info/exclude` instead until we have an opinion on this

* feat: add "tsconfig" as shared-data devDependency, revert relative path in tsconfig

* refactor: tool call parsing into function

* Update apps/studio/evals/assistant.eval.ts

Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

* refactor: organize mock schemas and tool factories

---------

Co-authored-by: Ali Waseem <waseema393@gmail.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
2025-12-22 23:45:48 -05:00
Ali Waseem
3d178fcad2 chore: trying arm runners for linting plus MORE MEM (#41472)
* trying arm runners for linting plus MORE MEM

* updated arm check s

* remove unneeded options

* smaller x86 runner to check performance

* Update .github/workflows/typecheck.yml

Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

* trying arm one more time

* remove arm its just way to slow

---------

Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
2025-12-18 21:09:18 +00:00
Etienne Stalmans
346fccec85 chore: cleaner action gh tokens (#41196) 2025-12-09 15:54:40 +01:00
Joshen Lim
9c244df9f1 Add columns to database indexes UI (#41152)
* Add columns to database indexes UI

* Nit

* Update codeowner
2025-12-09 22:27:23 +08:00
Raúl Barroso
10cea1e556 feat: add validate pr workflow (#41061) 2025-12-04 15:21:43 +00:00
Ivan Vasilov
af5ad5ac47 chore: Simplify environment approval for tests (#40872)
Simplify environment approval for tests

Removed environment approval requirement for forked PRs.
2025-11-27 16:02:39 +00:00
Ali Waseem
e23175f00b Feat: E2E tests for AI assistant and log drains (#40844)
* updated commands and expose ai key locally

* added tests for AI assistant

* added OPEN_API_KEY for e2e test suite

* updated log drain options

* updated README
2025-11-27 15:27:50 +00:00
Katerina Skroumpelou
ce1cf19b51 ci: add contents-write to fix-typos (#40869) 2025-11-27 14:32:31 +00:00
Matt Rossman
8f8f57b8c6 feat: show published studio tags in workflow summary (#40802)
* feat: test workflow with GitHub step summary

* fix: run test workflow on commit

* feat: tweak summary

* fix: format

* feat: format as table

* fix: wording

* fix: format

* feat: remote test workflow, add summary to `publish_image.yml`

* fix: wording
2025-11-25 16:51:23 -05:00
Ali Waseem
767f0f2bb4 Fix: updated studio to only run on paths, otherwise shortcut out (#40542)
* updated studio to only run on paths, otherwise shortcut out

* updated to include design system and ui library

* removed single qoute
2025-11-18 08:30:55 -07:00
Ali Waseem
7898abe06c Fix: Make self hosted tests more reliable locally and in CI (#40479)
* added ui studio command

* added SKIP ASSET UPLOAD option

* updated failing tests

* updated e2e scripts to include CI instructions

* removed unused envs and slack messages

* updated timeouts and max retries on CI

* updated generated local env

* updated env

* updated env generation for e2e tests

* remove vercel preview

* updated tests and trying junit report on PR

* update test comment

* updated commit hash for reporter

* updated file path

* updated runner to blacksmith

* update test file for reporting

* Update .github/workflows/studio-e2e-test.yml

Co-authored-by: Charis <26616127+charislam@users.noreply.github.com>

* Update package.json

Co-authored-by: Charis <26616127+charislam@users.noreply.github.com>

* Update e2e/studio/playwright.config.ts

Co-authored-by: Charis <26616127+charislam@users.noreply.github.com>

* updated to skip comment on forks

---------

Co-authored-by: Charis <26616127+charislam@users.noreply.github.com>
2025-11-17 15:00:31 -07:00
Andrey A.
c82a0191c9 chore: add self-hosted team to codeowners and remove aantti (#40468) 2025-11-14 10:21:38 -03:30
Bobbie Soedirgo
20b5c203c7 chore: add @avallete as code owner for pg-meta package (#40161) 2025-11-13 12:53:34 -05:00
dependabot[bot]
6cc89a2d44 chore(deps): bump pnpm/action-setup from 4.1.0 to 4.2.0 (#39740)
Bumps [pnpm/action-setup](https://github.com/pnpm/action-setup) from 4.1.0 to 4.2.0.
- [Release notes](https://github.com/pnpm/action-setup/releases)
- [Commits](a7487c7e89...41ff726559)

---
updated-dependencies:
- dependency-name: pnpm/action-setup
  dependency-version: 4.2.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-11-12 12:28:32 -05:00
Ali Waseem
23c7c8c63e Fix: updated action to include state (#40385)
* updated action to include state

* removed CI status

* Update .github/workflows/dashboard-pr-reminder.yml

Co-authored-by: Charis <26616127+charislam@users.noreply.github.com>

---------

Co-authored-by: Charis <26616127+charislam@users.noreply.github.com>
2025-11-12 16:01:41 +00:00
Ali Waseem
1b81ebb7e3 Fix: added PR reminder action for Dashboard team (#40357)
* added PR reminder action

* remove unneeded comment

* updated to trigger force

* updated to skip PRs that forks for now

* updated secret

* updated script

* updated env to pass correct values

* updated formatting

* [debug] just print the first block

* updated to remove dependabot

* updated to remove draft PRs

* updated to ignore merge conflicts

* removed merge conflict check

* updated time zone for PR reminders

* removed dashboard pr to push branch
2025-11-12 07:47:36 -05:00
Charis
dad9f4e484 ci: add eslint ratcheting (#40156)
* chore: add eslint ratchet script

* chore: add eslint ratchet action

* refactor(ratchet script): convert to typescript

* ci(ratchet script): add --decrease-baselines flag

Allows us to decrease the baselines on schedule as we fix warnings

* ci(ratchet): add action to decrease baseline if possible every week

* chore(eslint): fix exhaustive-deps error

* docs(internal): improve docs for eslint ratchet script

* chore(ratchet): add new ratchet rules

Add:
- import/no-anonymous-default-export
- @tanstack/query/exhaustive-deps
- @tanstack/query/no-deprecated-options

Not adding `no-restricted-exports` even though we have many violations
because we first need to reconfigure it (if possible) to ignore those
files where Next.js requires a default export.
2025-11-10 18:49:22 +00:00
github-actions[bot]
d7f856965a [bot] Sync from supabase/troubleshooting (#40147)
* Sync from supabase/troubleshooting

* fix(troubleshooting metdata): invalid toml in titles

* format(troubleshooting)

* lint(troubleshooting): apply mdx lint fixes

---------

Co-authored-by: github-docs-bot <github-docs-bot@supabase.com>
Co-authored-by: Charis Lam <26616127+charislam@users.noreply.github.com>
2025-11-04 18:25:12 +00:00
Charis
99cb35e0f4 ci(docs): add workflow to sync new guides from supabase/troubleshooting (#40091) 2025-11-04 17:50:53 +00:00
Jordi Enric
4c151ec01d e2e fixes (#39845)
* only require approval on forks

* update readme

* update example

* update readme
2025-10-24 16:24:55 +02:00
Katerina Skroumpelou
416df4afa4 chore: respect catalog version for postgrest-js (#39837) 2025-10-24 11:58:56 +03:00
Greg Richardson
38cae5aa41 chore: @supabase/postgres as code owner for pg-meta package (#39817) 2025-10-23 12:45:31 -06:00
Charis
3dc44d3a51 ci(dependabot): don't get prompted for major version updates for github actions (#39733)
Major version updates require more preparation and testing, so we only
want to update these on our schedule / if actually deprecated, not be
prompted as soon as a new major version comes out. We mostly want to
keep patch/minor updates so we can be aware of any vulnerability fixes.
2025-10-21 19:39:25 +00:00
Charis
3973cc3e5c chore: update github workflows (#39237) 2025-10-20 09:36:45 -04:00
Andrey A.
31a50408a8 chore: add aantti to codeowners for ./docker (#39523) 2025-10-14 17:23:20 +08:00
Katerina Skroumpelou
b7f1616e3c chore: update docs from js monorepo (#39200)
* chore: update docs from js monorepo

* chore: remove sparse-checkout for workflow to work

* chore: update workflow with no-frozen-lockfile

* chore(js libs docs update): regenerate typespec snapshot on update

* fix(typespec): fix missing types in transformed typespec

---------

Co-authored-by: Charis Lam <26616127+charislam@users.noreply.github.com>
2025-10-03 12:02:53 +03:00
Alaister Young
9ba9c08ef4 chore: add nimbus auto sync (#39182)
* chore: add nimbus auto sync

* trigger on branch for testing

* remove client payload

* try v4

* run only on master
2025-10-01 21:53:49 +00:00
Katerina Skroumpelou
f0ac5fb116 chore: add js libs auto-update workflow (#39037)
* chore: add js libs auto-update workflow

* chore: exclude js libs from minimum age
2025-10-01 12:24:30 +00:00
Katerina Skroumpelou
8d87b66974 docs: automate js libs docs update (#39036) 2025-09-30 11:01:29 +03:00
Jordi Enric
25abebc32e a new hope (#38893)
* a new hope

* run tests in ci against cli mode

* summary

* try vercel action to run e2e against studio self hosted preview

* believe

* debug

* gh pages artifact

* test

* rm pages step

* fix automation bypass missing

* continue on error

* only install necessary deps for CI

* fix bypass

* remove

* fail job if test fails

* disable customer query if is_platform false

* vercel check

* fix var name, make comment update instead

* check bypass on runtime

* add env var

* fix tests going to project ref instead of default

* fix

* better dates in comment

* Update E2E test workflow to include flaky test detection and improve summary output

* fix

* fix dumb mistake
2025-09-23 12:02:23 +02:00
Ivan Vasilov
dc5ab444df feat: Add typechecking as a required check for the merge queue (#38939)
* Disable typesafe builds on prod for studio.

* Add typecheck github action to the merge queue checks.

* Add typescript dependency to packages to stabilize their versions.

* Add tailwindcss to the catalog.
2025-09-23 11:34:56 +02:00
Jordi Enric
10d96127e5 coveralls: fail-on-error false (#38866)
failonerror false
2025-09-19 17:32:13 +02:00
Charis
66d8ee67b9 fix: docs sync script (#38795) 2025-09-18 16:05:23 -04:00
Charis
8cd5e10038 feat: alternate search index for nimbus (#38662)
* feat: alternate search index for nimbus

Create an alternate search index for Nimbus that filters out
feature-flagged pages (equivalent to setting all feature flags to
false).

Notes:
- Creates two new DB tables, `page_nimbus` and `page_section_nimbus`,
  which are filtered versions of `page` and `page_section`
- Makes `nimbus` versions of all the DB search functions
- Refactored the embedding upload script. Changes to make it faster (got
  annoyed by how slow it was when testing...), incorporate retries, and
  produce better summary logs.
- Upload script, when run with the environment variable
  ENABLED_FEATURES_OVERRIDE_DISABLE_ALL, produces and uploads the
  alternate search index
- Changed all the search calls in frontend/API to check for
  `isFeatureEnabled('search:fullIndex')` to determine whether to search
  the full or alternate index

* ci: produce nimbus search indexes on merge

* fix: turn full search index on
2025-09-16 12:37:53 -04:00
Etienne Stalmans
ec66608c25 chore: stricter action config for labeler (#38708)
* chore: stricter action config for labeler

* chore: checkout not needed
2025-09-15 14:26:05 +00:00
Chris Chinchilla
407d466aaf chore: Add labeler action and documentation config (#38704)
* Add labeler action and documentation config

* Update .github/labeler.yml

Co-authored-by: Raúl Barroso <code@raulb.dev>

---------

Co-authored-by: Raúl Barroso <code@raulb.dev>
2025-09-15 12:02:04 +00:00
Katerina Skroumpelou
a5fc052704 docs: update js client libs docs (#38595)
* docs: update js client libs docs

* chore: update test snapshot for specs

* ci(docs): run tests on spec changes

---------

Co-authored-by: Charis Lam <26616127+charislam@users.noreply.github.com>
2025-09-11 12:14:27 +01:00
Kevin Grüneberg
dfb152ab8c chore: consolidate payment method components / ownership (#38578)
Security approval is required for PCI compliance. This means we need security approval wherever we embed Stripe for payment methods.

Security approval was previously very coarse and most billing changes required security approval unnecessarily.

This PR aims to move all files relevant for payment method display/changes into a single folder and adjusts the ownership to only require security approval for that.
2025-09-10 13:54:36 +08:00
Charis
47705a8968 chore: replace all supabase urls with relative urls (#38537)
* fix: rewrite relative URLs when syncing to GitHub discussion

Relative URLs back to supabse.com won't work in GitHub discussions, so
rewrite them back to absolute URLs starting with https://supabase.com

* fix: replace all supabase urls with relative urls

* chore: add linting for relative urls

* chore: bump linter version

* Prettier

---------

Co-authored-by: Chris Chinchilla <chris.ward@supabase.io>
2025-09-09 12:54:33 +00:00
blacksmith-sh[bot]
96f99014d8 .github/workflows: Migrate workflows to Blacksmith runners (#38549)
Migrate workflows to Blacksmith

Co-authored-by: blacksmith-sh[bot] <157653362+blacksmith-sh[bot]@users.noreply.github.com>
2025-09-09 18:27:43 +08:00
Kevin Grüneberg
742b720b37 chore: use built-in GH runner (#38544)
Temp fix until blacksmith is unblocked
2025-09-09 06:14:15 +00:00
Kevin Grüneberg
1363954156 ci: use blacksmith (#38543) 2025-09-09 05:10:46 +00:00
Charis
11ebbb7a7c fix: embedding upload error (#38439)
Markdown processing for uploads now depends on the 'common' package (for
feature flag querying). Added it to the GitHub Workflow to make sure
it is accessible during that step. (Actually added the whole packages
directory since it seems likely that we might need other stuff from this
in the future.)
2025-09-04 11:47:47 -04:00