Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

WordPress Playground Integration Planning #14

Open
bengreeley opened this issue Jan 27, 2023 · 15 comments
Open

WordPress Playground Integration Planning #14

bengreeley opened this issue Jan 27, 2023 · 15 comments

Comments

@bengreeley
Copy link

This issue is meant for planning purposes of possible integration with WordPress Playground

Considerations:

  • Setting/configuring default data
  • Importing default data (Support Default Content/Options wordpress-playground#115)
  • Leveraging the existing Starter Content functionality for themes
  • Opt-in vs opt-out process for theme and plugin authors
  • How to handle themes and plugins that are dependent on other plugins
  • Rollout process
@adamziel
Copy link

I'm glad to see this issue! Here's some notes:

Setting/configuring default data

A PHP script coming from a plugin developer would do the trick – Playground can execute PHP code after all.

Importing default default data

One approach would be to allow developers to upload a bundle of starter content/data. @artemiomorales is exploring import/export support to make this possible.

Leveraging the existing Starter Content functionality for themes

I'm not familiar with the details of the Starter Content feature, but just noting that some non-block themes can already set up the starter content: https://wasm.wordpress.net/wordpress.html?theme=pendant

How to handle themes and plugins that are dependent on other plugins

Developers should have to declare the dependencies somewhere. Perhaps this could be solved on the ecosystem level by introducing plugin.json or a similar construct? Plugins are de-facto packages after all.

@adamziel
Copy link

Big picture-wise, I imagine a "Live Preview management" UI where the developers could:

  • Find the docs and learn everything they need to know about the process
  • Turn the live preview on or off
  • Add a preconfiguration PHP script
  • Add a starter content bundle as a zip file – with instructions on how to prepare one and how to test it locally before uploading
  • Declare dependent plugins
  • Choose the default theme for the demo

Thinking a step further, there could be a generic "WordPress Playground package" format (like a .phar archive) that would encompass all of the above and would benefit from local development tools.

@dd32
Copy link
Member

dd32 commented Jun 28, 2024

Just noting:

  • Theme guidelines don't allow themes to require plugins. They can encourage it, but can't require it.
  • Blueprints are not ideal for live previews, as implemented for plugins, and initial implementation for themes in Playground Previews #118
    • This is due to the time taken to setup the site from scratch each time, and imports being a bad experience with WXR currently
    • Block Themes don't have an easy way to use Starter Content or define templates in a blueprint without custom PHP.
    • Any assets can't be included in a blueprint, and usually end up stored on GitHub.
    • Creating JSON isn't very friendly for many people.

there could be a generic "WordPress Playground package" format (like a .phar archive) that would encompass all of the above and would benefit from local development tools.

This would be ideal, although my notes:

  • Todays Playground supports an Import/Export as .zip which works well for this
  • That isn't perfect for our use-case, as..
    • We probably want to allow upload of a .zip, but we'll want to discard all themes/plugins included within
      • Maybe we'd allow w.org hosted plugins..
      • That means the only thing we'd actually want from the archive is probably the Database + any uploaded assets.
    • Inject the latest version of the theme (and it's parent) / plugins (if w.org hosted are added..)
    • We'd need to run certain actions to ensure our custom plugins are loaded when needed
      • I guess this would just be us injecting our plugins, and then an mu-plugin to ensure they're loaded (or probably just injecting them as mu-plugins now that I think about it)
      • With Blueprints we just run our actions first & last, but I guess mu-plugins probably covers our needs.

So thinking about this... That would be:

  • Allow upload of an export
  • Process of upload to determine the included plugins, take note of the ones we want to include, discard all themes
  • Store it somewhere
  • Allow download of the export, dynamically inject the theme & it's parents, inject our mu-plugins, inject any w.org plugins we determine we want to allow
  • Have the preview bootup be:
    • Install WP, overlay preview zip
    • Currently AFAIK this would install WP, then we'd overwrite the DB with the preview one.
    • This wouldn't be significantly faster than using a Blueprint today, except in the case of WXR imports and Block Themes that need DB customisations.

Bigger picture, It does make me question if this is actually a Theme Preview problem though ultimately; perhaps theme previews are just a subset of Playground Demo's, WordPress sites that we have in a directory as a starting point for new WordPress sites. They would include Blueprints, and full exports with DB/etc (which again, like above we'd probably want to inject the latest versions at download time, cached per day).

@adamziel
Copy link

adamziel commented Jul 16, 2024

@dd32 So the overall goal here is snappy theme preview loading, right?

Would the step you listed happen server-side with a cronjob? Or in the browser? For the former, Playground CLI + some custom scripting could help. For the latter, a export.zip -> sanitized-theme-preview.zip Blueprint + an additional "path allowlist / denylist" option in the import zip step would perhaps do the trick.

However, I wonder if that wouldn't actually slow down the boot once Offline Mode support lands. That's because after the initial load, your browser will source PHP and WordPress.zip from cache, so serving a new .zip bundle with all WordPress core files would add to the overall transfer size. Looping in @bgrgicak

Bigger picture, It does make me question if this is actually a Theme Preview problem though ultimately; perhaps theme previews are just a subset of Playground Demo's, WordPress sites that we have in a directory as a starting point for new WordPress sites. They would include Blueprints, and full exports with DB/etc (which again, like above we'd probably want to inject the latest versions at download time, cached per day).

Yes, I think that's a more general Playground apps problem. I hope the offline mode will greatly speed it up.

@adamziel adamziel moved this from Needs Triage/Our Reply to Needs Author's Reply in Playground Board Jul 16, 2024
@dd32
Copy link
Member

dd32 commented Jul 17, 2024

@dd32 So the overall goal here is snappy theme preview loading, right?

Yes, to reduce the speed of loading as much as possible. I wasn't aware of Offline mode, but I don't think it impacts too much.

Would the step you listed happen server-side with a cronjob? Or in the browser?

Probably it would be that the theme author would upload a ZIP, sourced from a playground instance Export option.

For the latter, a export.zip -> sanitized-theme-preview.zip Blueprint + an additional "path allowlist / denylist" option in the import zip step would perhaps do the trick.

That's what I was thinking; except, the path allow/deny probably wouldn't be needed, my thought was we'd take the export.zip provided, remove anything from the ZIP that's not expected (the theme, plugins, etc) and have the client download the sanitised-export.zip + theme.zip + plugin1.zip + plugin2.zip.. I guess ideally we'd have those all bundled up, but probably not viable at first.

That's because after the initial load, your browser will source PHP and WordPress.zip from cache, so serving a new .zip bundle with all WordPress core files would add to the overall transfer size.

100% We'd want the bundle to exclude the PHP/WordPress zip, and only have anything unique to the theme preview.

I hope the offline mode will greatly speed it up.

I'm not sure it will greatly, since the WordPress+PHP+Wasm+etc zips are already cached client-side. The main speed issue I've seen is just waiting for them to download on a cold-boot (Offline doesn't help that) and that it appears that WordPress is installed from scratch every boot (I didn't think that would be a speed issue,and I'm not certain it is, other than that after the ZIPs download there's a second or two while it's "setting up WordPress")

@adamziel adamziel moved this from Needs Author's Reply to Inbox in Playground Board Jul 17, 2024
@bgrgicak
Copy link

However, I wonder if that wouldn't actually slow down the boot once WordPress/wordpress-playground#133 support lands. That's because after the initial load, your browser will source PHP and WordPress.zip from cache, so serving a new .zip bundle with all WordPress core files would add to the overall transfer size. Looping in @bgrgicak

This isn't necessarily related to offline and could be considered an issue today.

We download WordPress here and it looks like the only thing that disables the download is if WordPress is available in OPFS.

If we want to avoid downloading WordPress twice, we could use the prefferdVersions.wp with a URL to download a customized version or WordPress. Example blueprint.

These ZIPs wouldn't be cached because they don't come from the Playground.WordPress.net, but that could be improved in the future.

100% We'd want the bundle to exclude the PHP/WordPress zip, and only have anything unique to the theme preview.

That would resolve the issue.

@bgrgicak bgrgicak moved this from Inbox to Needs Triage/Our Reply in Playground Board Jul 19, 2024
@bgrgicak bgrgicak moved this from Needs Triage/Our Reply to Inbox in Playground Board Jul 19, 2024
@adamziel
Copy link

Playground now supports offline mode. PHP and WP are downloaded just once, additional bundles like plugins and themes are a subject to HTTP caching. This doesn't help with a cold load, but it helps with subsequent loads.

From here, there's a few ways to reduce the initial download size. One is what you outlined @dd32, it seems like there are no technical blockers for this. Another would be pre-rendering the theme as a static site using Playground CLI and shipping that. There's also a hybrid approach where we'd still load Playground and the theme, but all the images and CSS files would be fetched from the remote server instead of being shipped with the initial theme.zip.

@adamziel adamziel moved this from Inbox to Needs Author's Reply in Playground Board Jul 31, 2024
@richtabor
Copy link
Member

What's the difference between previewing a theme and previewing a plugin?

We could just add a "Open in WordPress Playground" button if a blueprint is available. That would set expectations that you will wait for something more. And just keep the existing preview button for now.

Then if we get blueprints loading quicker, just use the Preview button.

@adamziel adamziel moved this from Needs Author's Reply to Inbox in Playground Board Jul 31, 2024
@dd32
Copy link
Member

dd32 commented Aug 1, 2024

What's the difference between previewing a theme and previewing a plugin?

The primary difference is that Themes almost 100% require additional content be installed, which may include images, which is significantly slower to provision than plugins.

If we were adding plugin previews with playground today, I'm not 100% that blueprints would be the right option either, it may be that any theme preview functionalities are ported back over to plugins too.

@adamziel
Copy link

adamziel commented Aug 1, 2024

@dd32 What would you say is the largest blocker for this today, assuming the extra content like images may be referenced from an external URL without frontloading them in Playground?

@brandonpayton brandonpayton moved this from Inbox to Needs Author's Reply in Playground Board Aug 5, 2024
brandonpayton added a commit to WordPress/wordpress-playground that referenced this issue Aug 19, 2024
## Motivation for the change, related issues

The GitHub board automation workflow is failing due to a permissions
error when attempting to create a label for the wporg-theme-directory
repo.


https://github.com/WordPress/wordpress-playground/actions/runs/10459089537/job/28962281299#step:3:7002

```
      ["message"]=>
      string(71) "adamziel does not have the correct permissions to execute `CreateLabel`"
    }
  }
}
Error processing card: WordPress/wporg-theme-directory#14 (WordPress Playground Integration Planning)
GraphQL query failed
Skipping that one and continuing...
```

## Implementation details

This change simply skips label updates for the wporg-theme-directory
repo for which we do not have permission to create new labels.

## Testing Instructions (or ideally a Blueprint)

- Test by manually running the board automation workflow from this PR's
branch and make sure the workflow succeeds.
- Try changing another issue's board status, rerun the workflow, and
observe that the status is reflected in changed issue labels.
- Restore the original issue status, rerun the workflow, and observe the
original label has been restored.
@dd32
Copy link
Member

dd32 commented Sep 2, 2024

@adamziel I'm not sure. I suspect the biggest blocker that I'm aware of is an easy way to boot up a WordPress instance with a defined DB rather than the builtin. I'm sure there's a way to do it, but I'm not aware off the top of my head of how to using vanilla playground.

(ie. Last I looked, there wasn't a clear way to boot a Playground instance to resume a saved state / export, you boot, then import zip and overwrite the initialised environment)

@adamziel adamziel moved this from Needs Author's Reply to Inbox in Playground Board Sep 2, 2024
@adamziel
Copy link

adamziel commented Sep 9, 2024

@dd32 there's a few ways to approach this:

  1. Export a Playground instance as a zip, host that zip somewhere, load it through the API. I did that for the slides example at https://github.com/adamziel/playground-sites via the import-site query API parameter: https://playground.wordpress.net/?login=no&import-site=https%3A%2F%2Fraw.githubusercontent.com%2Fadamziel%2Fplayground-sites%2Fmain%2Fplayground-for-site-builders%2Fplayground.zip
  2. Setup a Blueprint to define the desired DB state. I'm not sure if that would do the trick, though, maybe there's too much to do to reasonably encode it as a Blueprint.
  3. Prepare a database file and prepare a Blueprint that replaces the Playground SQLite database file with your custom file using the writeFile Blueprint step.

Is this what you've had in mind? I know @annezazu and @juanmaguitar also explored restoring the Playground site from a ZIP export.

@adamziel adamziel moved this from Inbox to Needs Author's Reply in Playground Board Sep 9, 2024
@dd32
Copy link
Member

dd32 commented Sep 10, 2024

I wasn't aware of the importSite option. I think that would meet most of the need here.

It looks like under the hood this just maps to the importWordPressFiles blueprint step, so we'd probably be using a Blueprint that did... steps: [ { ..importWordPressFiles...}, { ...login... }, { ...installTheme... } ], which would do what we needed here.

@adamziel adamziel moved this from Needs Author's Reply to Inbox in Playground Board Sep 10, 2024
@annezazu
Copy link

Yes! I use this option a fair amount. Most recently: https://nomad.blog/2024/08/29/join-me-in-testing-block-bindings-api/ Makes it super easy to offer ways for folks to help test.

@adamziel
Copy link

Yay! If I understand correctly, this is unblocked now 🎉

@adamziel adamziel moved this from Inbox to Needs Author's Reply in Playground Board Sep 11, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Archived in project
Development

No branches or pull requests

6 participants