Writing Packages
Edit on GitHub | Discuss on the Meteor Forums
After reading this article, you’ll know:
- When to create an npm package and when to create an Atmosphere package
- The basics of writing an npm package
- The basics of writing an Atmosphere package
- How to depend on other packages, both from Atmosphere and npm
- How an Atmosphere package can integrate with Meteor’s build system
The Meteor platform supports two package systems: npm, a repository of JavaScript modules for Node.js and the browser, and Atmosphere, a repository of packages written specifically for Meteor.
npm vs. Atmosphere
With the release of version 1.3, Meteor has full support for npm. In the future, there will be a time when all packages will be migrated to npm, but currently there are benefits to both systems. You can read more about the tradeoffs between Atmosphere and npm in the Using Packages article.
If you want to distribute and reuse code that you’ve written for a Meteor application, then you should consider publishing that code on npm if it’s general enough to be consumed by a wider JavaScript audience. It’s simple to use npm packages from Meteor applications, and possible to use npm packages from Atmosphere packages, so even if your main audience is Meteor developers, npm might be the best choice.
However, if your package depends on an Atmosphere package (which, in Meteor 1.3, includes the Meteor core packages), or needs to take advantage of Meteor’s build system, then writing an Atmosphere package might be the best option.
Creating an npm package
If you want to override a package that already exists in the npm registry, use this method.
To create a new package:
1 | mkdir my-package |
The last command creates a package.json
file and prompts you for the package information. You may skip everything but name
, version
, and entry point
. You can use the default index.js
for entry point
. This file is where you set your package’s exports:
1 | // my-package/index.js |
Now apps that include this package can do:
1 | import { myPackageLog } from 'my-package' |
Including in your app
When you are developing a new npm package for your app, there are a couple methods for including the package in your app:
- Inside node_modules: Place the package in your app’s
node_modules/
directory, and add the package to source control. Do this when you want everything in a single repository.
1 | cd my-app/node_modules/ |
- npm link: Place the package outside your app’s directory in a separate repository and use
npm link
. Do this when you want to use the package in multiple apps.
1 | cd ~/ |
Other developers will also need to run the npm link
command.
After either method, edit the dependencies
attribute of my-app/package.json
, adding "my-package": "1.0.0"
(use the same version number you chose during meteor npm init
).
Publishing your package
You can share your package with others by publishing it to the npm registry. While most packages are public, you can control who may view and use your package with private modules).
To publish publicly, follow these instructions. When you’re done, anyone can add your package to their app with npm install --save your-package
.
If you want to share packages during development, we recommend using the above methods instead of the registry. If you use the registry, then every time you change the package, you need to increment the version number, publish, and then npm update my-package
inside your app.
Creating an Atmosphere package
To get started writing a package, use the Meteor command line tool:
1 | meteor create --package my-package |
It is required that your
my-package
name take the form ofusername:my-package
, whereusername
is your Meteor Developer username, if you plan to publish your package to Atmosphere.
If you run this inside an app, it will place the newly generated package in that app’s packages/
directory. Outside an app, it will just create a standalone package directory. The command also generates some boilerplate files for you:
1 | my-package ├── README.md ├── package.js ├── my-package-tests.js └── my-package.js |
The package.js
file is the main file in every Meteor package. This is a JavaScript file that defines the metadata, files loaded, architectures, npm packages, and Cordova packages for your Meteor package.
In this guide article, we will go over some important points for building packages, but we won’t explain every part of the package.js
API. To learn about all of the options, read about the package.js
API in the Meteor docs.
Don’t forget to run
meteor add [my-package]
once you have finished developing your package in order to use it; this applies if the package is a local package for internal use only or if you have published the package to Atmosphere.
Adding files and assets
The main function of an Atmosphere package is to contain source code (JS, CSS, and any transpiled languages) and assets (images, fonts, and more) that will be shared across different applications.
Adding JavaScript
To add JavaScript files to a package, specify an entrypoint with api.mainModule()
in the package’s onUse
block (this will already have been done by meteor create --package
above):
1 | Package.onUse(function(api) { |
From that entrypoint, you can import
other files within your package, just as you would in an application.
If you want to include different files on the client and server, you can specify multiple entry points using the second argument to the function:
1 | Package.onUse(function(api) { |
You can also add any source file that would be compiled to a JS file (such as a CoffeeScript file) in a similar way, assuming you depend on an appropriate build plugin.
Adding CSS
To include CSS files with your package you can use api.addFiles()
:
1 | Package.onUse(function(api) { |
The CSS file will be automatically loaded into any app that uses your package.
Adding Sass, Less, or Stylus mixins/variables
Just like packages can export JavaScript code, they can export reusable bits of CSS pre-processor code. You can also have a package that doesn’t actually include any CSS, but just exports different bits of reusable mixins and variables. To get more details see Meteor build tool CSS pre-processors:
1 | Package.onUse(function(api) { |
This Sass file will be eagerly evaluated and its compiled form will be added to the CSS of the app immediately.
1 | Package.onUse(function(api) { |
These two Sass files will be lazily evaluated and only included in the CSS of the app if imported from some other file.
Adding other assets
You can include other assets, such as fonts, icons or images, to your package using api.addAssets
:
1 | Package.onUse(function(api) { |
You can then access these files from the client from a URL /packages/username_my-package/font/OpenSans-Regular-webfont.eot
or from the server using the Assets API.
Exporting
While some packages exist just to provide side effects to the app, most packages provide a reusable bit of code that can be used by the consumer with import
. To export a symbol from your package, simply use the ES2015 export
syntax in your mainModule
:
1 | // in my-package.js: |
Now users of your package can import the symbol with:
1 | import { myName } from 'meteor/username:my-package'; |
Dependencies
Chances are your package will want to make use of other packages—to ensure they are available, you can declare dependencies. Atmosphere packages can depend both on other Atmosphere packages, as well as packages from npm.
Atmosphere dependencies
To depend on another Atmosphere package, use api.use
:
1 | Package.onUse(function(api) { |
One important feature of the Atmosphere package system is that it is single-loading: no two packages in the same app can have dependencies on conflicting versions of a single package. Read more about that in the section about version constraints below.
Depending on Meteor version
Note that the Meteor release version number is mostly a marketing artifact—the core Meteor packages themselves typically don’t share this version number. This means packages can only depend on specific versions of the packages inside a Meteor release, but can’t depend on a specific release itself. We have a helpful shorthand api called api.versionsFrom
that handles this for you by automatically filling in package version numbers from a particular release:
1 | // Use versions of core packages from Meteor 1.2.1 |
The above code snippet is equivalent to the code below, which specifies all of the version numbers individually:
1 | api.use([ |
Semantic versioning and version constraints
Meteor’s package system relies heavily on Semantic Versioning, or SemVer. When one package declares a dependency on another, it always comes with a version constraint. These version constraints are then solved by Meteor’s industrial-grade Version Solver to arrive at a set of package versions that meet all of the requirements, or display a helpful error if there is no solution.
The mental model here is:
- The major version must always match exactly. If package
a
depends onb@2.0.0
, the constraint will only be satisfied if the version of packageb
starts with a2
. This means that you can never have two different major versions of a package in the same app. - The minor and patch version numbers must be greater or equal to the requested version. If the dependency requests version
2.1.3
, then2.1.4
and2.2.0
will work, but2.0.4
and2.1.2
will not.
The constraint solver is necessary because Meteor’s package system is single-loading - that is, you can never have two different versions of the same package loaded side-by-side in the same app. This is particularly useful for packages that include a lot of client-side code, or packages that expect to be singletons.
Note that the version solver also has a concept of “gravity” - when many solutions are possible for a certain set of dependencies, it always selects the oldest possible version. This is helpful if you are trying to develop a package to ship to lots of users, since it ensures your package will be compatible with the lowest common denominator of a dependency. If your package needs a newer version than is currently being selected for a certain dependency, you need to update your package.js
to have a newer version constraint.
npm dependencies
Meteor packages can include npm packages to use JavaScript code from outside the Meteor package ecosystem, or to include JavaScript code with native dependencies.
If your package is using a dependency on the server then you can include npm packages in your Meteor package by using Npm.depends. For example, here’s how you could include the github
package from npm in your package.js
:
1 | Npm.depends({ |
You can import the dependency from within you package code in the same way that you would inside an application:
1 | import github from 'github'; |
Peer npm dependencies
Npm.depends()
is fairly rigid (you can only depend on an exact version), and will typically result in multiple versions of a package being installed if many different Atmosphere packages depend on the same npm package. This makes it less than ideal to use on the client, where it’s impractical to ship multiple copies of the same package code to the browser. Client-side packages are also often written with the assumption that only a single copy will be loaded. For example, React will complain if it is included more than once in an application bundle.
To avoid this problem as a package author, you can request that users of your package have installed the npm package you want to use at the application level. This is similar to a peer dependency of an npm package (although with less support in the tool). You can use the tmeasday:check-npm-versions
package to ensure that they’ve done this, and to warn them if not.
For instance, if you are writing a React package, you should not directly depend on react
, but instead use check-npm-versions
to check the user has installed it:
1 | import { checkNpmVersions } from 'meteor/tmeasday:check-npm-versions'; |
Note that
checkNpmVersions
will only output a warning if the user has installed a incompatible version of the npm package. So yourrequire
call may not give you what you expect. This is consistent with npm’s handling of peer dependencies.
Cordova plugins
Meteor packages can include Cordova plugins to ship native code for the Meteor mobile app container. This way, you can interact with the native camera interface, use the gyroscope, save files locally, and more.
Include Cordova plugins in your Meteor package by using Cordova.depends.
Read more about using Cordova in the mobile guide.
Testing packages
Meteor has a test mode for packages called meteor test-packages
. If you are in a package’s directory, you can run
1 | meteor test-packages ./ --driver-package practicalmeteor:mocha |
This will run a special app containing only a “test” version of your package and start a Mocha test driver package.
When your package starts in test mode, rather than loading the onUse
block, Meteor loads the onTest
block:
1 | Package.onTest(function(api) { |
From within your test entry point, you can import other files as you would in the package proper.
You can read more about testing in Meteor in the Testing article.
Peer npm dependencies
If your package makes use of peer npm dependencies, you cannot currently use test-packages
to write package tests (as the dependencies will not be included in the special test app).
To work around this, you can create a “scaffolding” test application, which is a simple app which simply includes the package and uses standard tests to run tests against the package. You can see examples of these kind of scaffold test apps in the React packages repository.
Local packages vs. published packages
If you’ve ever looked inside Meteor’s package cache at ~/.meteor/packages
, you know that the on-disk format of a built Meteor package is completely different from the way the source code looks when you’re developing the package. The idea is that the target format of a package can remain consistent even if the API for development changes.
To publish your package to Atmosphere, run meteor publish
from the package directory. To publish a package the package name must follow the format of username:my-package
and the package must contain a SemVer version number.
Build plugins
The most powerful feature of Meteor’s build system is the ability to define custom build plugins. If you find yourself writing scripts that mangle one type of file into another, merge multiple files, or something else, it’s likely that these scripts would be better implemented as a build plugin. The ecmascript
, templating
, and coffeescript
packages are all implemented as build plugins, so you can replace them with your own versions if you want to!
Read the documentation about build plugins.
Types of build plugins
There are three types of build plugins supported by Meteor today:
- Compiler plugin - compiles source files (LESS, CoffeeScript) into built output (JS, CSS, asset files, and HTML). Only one compiler plugin can handle a single file extension.
- Minifier plugin - compiles lots of built CSS or JS files into one or more minified files, for example
standard-minifiers
. Only one minifier can handle each ofjs
andcss
. - Linter plugin - processes any number of files, and can print lint errors. Multiple linters can process the same files.
Writing your own build plugin
Writing a build plugin is a very advanced task that only the most advanced Meteor users should get into. The best place to start is to copy a different plugin that is the most similar to what you are trying to do. For example, if you wanted to make a new CSS compiler plugin, you could fork the less
package; if you wanted to make your own JS transpiler, you could fork ecmascript
. A good example of a linter is the jshint
package, and for a minifier you can look at standard-minifiers-js
and standard-minifiers-css
.
Caching
The best way to make your build plugin fast is to use caching anywhere you can - the best way to save time is to do less work! Check out the documentation about CachingCompiler to learn more. It’s used in all of the above examples, so you can see how to use it by looking at them.