Creating REST APIs
About RESTful Web Services
RESTful Web Services utilize the features of the HTTP Protocol to provide the API of the Web Service. For example, it uses the HTTP Request Types to indicate the type of operation:
Operation | HTTP Request Type |
---|---|
GET | Retrieving of existing records |
POST | Creating new records |
DELETE | Removing records |
PUT | Updating existing records |
PATCH | Partially updating existing records |
Using these 5 HTTP Request Types a RESTful API mimics the CRUD operations (Create, Read, Update(2) & Delete) common in transactional systems.
A defining feature of REST is that it is stateless: each call to a RESTful Web Service is completely stand-alone: it has no knowledge of previous requests.
Implementing a RESTful Web Service in Servoy
A RESTful Web Service endpoint is created by defining a Form in a Solution and implementing one or more of the following methods to the Form:
HTTP Request Type | Method name | Description |
---|---|---|
GET | ws_read | To retrieve data |
POST | ws_create | To create new data |
DELETE | ws_delete | To remove data |
PUT | ws_update | To update data |
PATCH | ws_patch | To partially update data |
The RESTful Web Service endpoint is then available through the URL
{serverUrl}/servoy-service/rest_ws/{solutionName}/{name}
.
Multiple endpoints can be created by implementing the relevant ws_*
methods on multiple forms or scopes with the given {name}
.
If the method for one of the HTTP Request Types is not implemented, that operation is not available on the endpoint and when attempted to be called a METHOD_NOT_ALLOWED
(HTTP 405) error will be thrown.
The RESTful Web Service plugin does not have any client side functions or properties: all its magic happens by implementing the methods with the predefined ws_*
names on a form.
Service Solution that has the web service implementation should be a Service type solution, this solution type should only be used for web service provider and batch processor.
Keeping It Stateless
RESTful Web Services are to be stateless. The RESTful Web Service plugin internally uses a pool of Headless Clients to handle multiple concurrent requests to the REStful Web Service API. As subsequent requests to the RESTful Web Service API might be handled by different headless clients in the pool of clients configured for the plugin, no state should be preserved in the headless client at the end of the call to the API. Therefore, make sure any state is cleared at the end of logic. This means at least the following:
Do not use global or form variables (or set them to default values at the end of the logic)
Do not use the solution model API
Do not alter the state of the form's UI
Do save or rollback any unsaved changes before the end of the method
Supporting GET Requests
GET requests are supported on the endpoint if the ws_read():Object
method is implemented. The method can return either a JavaScript primitive/array/object, a byte array or a JSFile
object. JSFile
objects can be used to stream large files to the client.
If the return value is a JavaScript object, it will be serialized and then placed in the body of the HTTP Response. See Returning Binary Data for more info on returning binary content.
If the return value of the method is null, a NOT_FOUND
response (HTTP 404) will be generated.
See what arguments you can receive in this method call at Additional arguments
Supporting POST Requests
POST requests are supported on the endpoint if the ws_create(content):Object
method is implemented. POST Requests require that data is supplied in the body of the request.
The body content of the HTTP Request is passed into the ws_create()
method as first argument. If the body Content-Type is not application/binary, it will be automatically converted to a JavaScript object / string.
If the body content cannot be converted to a JavaScript object / string based on the Content-Type, an INTERNAL_SERVER_ERROR
response (HTTP 500) will be generated. If the content in the body of the HTTP Request is missing, a NO_CONTENT
response will be generated (HTTP 204).
The ws_create()
method supports consumption of multipart post requests. If the POST Request is a multipart POST, the content
parameter will receive an Array of Objects, with each entry in the Array corresponding to one part of the multipart post, as per the example below:
The method can optionally return either a JavaScript primitive/array/object, a byte array or a JSFile
object. JSFile
objects can be used to stream large files to the client.
If the return value is a JavaScript object, it will be serialized and then placed in the body of the HTTP Response. See Returning Binary Data for more info on returning binary content.
See what other arguments you can receive in this method call at Additional arguments
Supporting DELETE Requests
DELETE requests are supported on the endpoint if the ws_delete():Object
method is implemented. The method can return various data types:
Boolean Values:
true: to indicate successful deletion. This result will generate an
OK
response (HTTP 200) unless a custom status has been set previouslyfalse: to indicate delete failure. This response will generate a
NOT_FOUND
response (HTTP 404)
Other Return Types (JSON, String, Integer, etc.):
Any of these types returned by default will set the response to OK (HTTP 200) unless a custom status has been set previously. The response body will contain the returned data.
null / undefined
:This will set the response to OK (HTTP 200) unless a custom status has been set previously. The response body will be empty.
See what other arguments you can receive in this method call at Additional arguments
Supporting PUT Requests
PUT requests are supported on the endpoint if the ws_update(content):Boolean
method is implemented. Data has to be supplied in the body of the HTTP request and the method has to return a Boolean value:
true: to indicate successful update. This result will generate an
OK
response (HTTP 200)false: to indicate update failure. This response will generate a
NOT_FOUND
response (HTTP 404)
The body content of the HTTP Request is passed into the ws_update()
method as first argument. If the body Content-Type is not application/binary, it will be automatically converted to a JavaScript object / string. The argument is the same as described above for POST.
If the body content cannot be converted to a JavaScript object / string based on the Content-Type an INTERNAL_SERVER_ERROR
response (HTTP 500) will be generated. If the content in the body of the HTTP Request is missing, a NO_CONTENT
response will be generated (HTTP 204).
Supporting PATCH Requests
PATCH requests are designed for partial updated (only certain fields). In the rest_ws
plugin the ws_patch()
method is called when implemented, the behaviour is the same as for PUT requests.
Additional arguments - when adding Extra Data to the Request URL or return values in ws_authenticate
Additional data can be added in the URL of the HTTP Requests. There are two variations and how they are made available in the ws_*
methods differs.
Additional URL Fragments
The base URL for each operation is {serverUrl}/servoy-service/rest_ws/{solutionName}/{name}
.
Additional URL fragments can be added to the URL like:
{serverUrl}/servoy-service/rest_ws/{solutionName}/{name}/{someValue}/{anotherValue}
The additional URL fragments {someValue}
and {anotherValue}
will be passed into the ws_*
method as additional arguments. This means that for ws_read()
and ws_delete()
they will be the first and second argument and for ws_create()
and ws_update()
they will be the 2nd and 3rd argument, as these methods already have by default the content of the request as first argument.
Query Parameters
The request URLs can also be extended with Query parameters like:
{serverUrl}/servoy-service/rest_ws/{solutionName}/{name}?{someKey}={someValue}&{anotherKey}={anotherValue}&&{anotherKey}={anotherValue2}
If the URL contains Query parameters, these will be passed into the ws_*
method as an additional last argument. This last argument is a JavaScript object containing all keys as properties with the values associated with the key in an Array: Object<Array>
Note that if Custom Endpoint Restrictions are implemented and the ws_authenticate()
method returns any value but null or false, the RESTful Web Services plugin adds a query parameter with the key ws_authenticate
and as value the returned value of the ws_authenticate()
method.
Combining Additional URL Fragments and Query Parameters
Additional URL path elements and Query parameters can be combined in the URL (the query parameters should come after the additional URL fragments to make it a valid URL):
{serverUrl}/servoy-service/rest_ws/{solutionName}/{name}/{someValue}/{anotherValue}?{someKey}={someValue}&{someKey}={anotherValue}&&{anotherKey}={anotherValue2}
Example
An HTTP Get Request on URL
{serverUrl}/servoy-service/rest_ws/myRestAPISolution/APIv1/foo/bar?name=John&age=30&pet=Cat&pet=Dog
would result in invoking the ws_read
method on form APIv1
of solution myRestAPISolution
.
The ws_read
function will be invoked with three parameters: 'foo'
, 'bar'
, {name: ['John'] , age: [30] , pet: ['Cat', 'Dog'] }
Supported Content Types & Encoding
The plugin supports the following Content Types:
JSON - application/json
XML - application/xml
binary - application/binary
Request Content-Type and Encoding
The Content-Type of the HTTP Request can be explicitly set by the caller using the Content-Type
header in the HTTP Request. Optionally, the charset can be included in the Content-Type header to specify the encoding used. If the charset is not specified, utf-8
will be assumed.
Content-Type Header |
---|
|
For requests that specify body content (POST and PUT Requests (resp. ws_create()
and ws_update()
methods), if no valid Content-Type is set, the plugin will try to establish the type of the content based on the first character of the content:
'{': Content-Type application/json will be assumed
'<': Content-Type application/xml will be assumed
When the Content-Type cannot be determined, an UNSUPPORTED_MEDIA_TYPE
response will be generated (HTTP 415).
Response Content-Type and Encoding
By default, the plugin will respond with the same content type as used in the HTTP Request. The client calling the RESTful Web Service can request a different response content type by specifying the desired content type for the Response by setting the Accept
header of the HTTP Request, for example: Accept: application/json
or Accept: application/binary
The response will be encoded with the utf-8
charset by default, if the response is not returning binary data.
If the encoding of the response needs to be different from the request encoding, this can be specified in the HTTP Request by setting the charset value in the Accept header:
Accept Header |
---|
|
Returning Binary Data
The RESTful Web Services plugin supports returning binary data in the operations. Binary data could for example be the content of a dataprovider of type MEDIA or the contents of a file read from disk. In this case, the body of the response will contain the actual stream of bytes.
Clients consuming the web service must be able to handle the binary response. When the consuming client specifies the Accept
header, it must accept application/binary
, otherwise an UNSUPPORTED_MEDIA_TYPE
(HTTP 415) response will be generated. If the consuming client did not specify the Content Type of the request, the binary result is returned unconditionally.
If you return large binary data, please use a JSFile
wrapper around an actual file on disk, then the bytes are just streamed directly from disk to the client over the http request without the need to read the bytes fully in memory.
Setting Custom Headers
Custom headers can be set in the response by implementing the ws_response_headers()
method. This method can return:
a string or an array of strings of type
headerName=headerValue
. For exampleServer=Servoy(Unix)
.an object or an array of objects containing headerName/headerValue pairs. For example
{ name : "Content-Disposition", value : 'attachment; filename="test.txt"' }
.
Each key/value pair will be added as Header to the HTTP Response.
Returning Custom Status Codes
While some of the HTTP Response status codes are hardcoded in the RESTful Webservices plugin, it is possible to control the HTTP Status codes from within the ws_*
methods. Returning a custom HTTP Status Code can be done by throwing the specific value (a number) for the HTTP Status Code.
For example, when a ws_update
call comes in for a non-existing resource, the HTTP Status Code to return would be a NOT_FOUND
status code, which is an HTTP 404. Returning the 404/Not Found HTTP Status code from within a ws_*
method could be done the following way:
It is also possible to set the body content of the HTTP Response with a more elaborate message to give more context to the returned status code:
For convenience purposes, all available HTTP Status Codes are also listed under the HTTP Plugin, so instead of throwing the number 404 in the first example, a more readable way would be to throw plugins.http.HTTP_STATUS.SC_NOT_FOUND
For additional explanation of all the status codes, see List of HTTP status codes on Wikipedia.
Authentication/Authorization
By default, access to any endpoint in unrestricted. The plugin supports 2 modes of implementing Authentication and authorization.
Restricting access to all endpoints based on HTTP Basic Authentication, validated against Servoy's built-in security
Restricting access per endpoint based on HTTP Basic Authentication with custom validation
Global Restrictions Based on Servoy Security
By setting the plugins server property rest_ws_plugin_authorized_groups
to a comma separated list of groups defined in the built-in security system of Servoy, access to all endpoints is automatically restricted to users that are part of the groups in the list.
The endpoints must be called with HTTP Basic authentication to provide a username and password. The username/password supplied in the HTTP Request is validated against the users registered in Servoy's built-in security system and additionally against group membership. Access is denied if the user does not exist or the supplied password is incorrect, or the user doesn't belong to one of the specified groups.
When access is denied, an UNAUTHORIZED
response is generated (HTTP 401).
Custom Endpoint Restrictions {#custom-endpoint-restrictions)
For each endpoint custom authentication and authorization can be added by implementing the ws_authenticate(userName, password):Object
method. If present, it will be called before performing any rest operation (ws_read, ws_create, ws_delete, ws_update) and the calls to the endpoint must be made with HTTP Basic Authentication to supply a username and password.
If the method returns false or null an UNAUTHORIZED
response is generated (HTTP 401).
Any other return value will be added as an extra query parameter (see Additional arguments) with the key ws_authenticate
to the incoming request.
JSONP support
The plugin supports so-called JSONP: a variation of JSON that allows cross domain data retrieval. The JSONP variation can be invoked by added a callback
parameter to the HTTP Request URL:
{serverUrl}/servoy-service/rest_ws/{solutionName}/{name}?callback={callbackFunctionName}
When invoked with the value myCallback
for the callback
parameter, the returned JSON value will be wrapped in a function call to the myCallback
function:
Versioning support
{serverUrl}/servoy-service/rest_ws/v2/mysolution/myform_or_scope/
or
{serverUrl}/servoy-service/rest_ws/mysolution/v2/myform_or_scope/
This is supported (the v
has to be there and the 2
must be a number).
What is looked up is in the myform_v2
form or the scope_v2
scope (for version 2 of the api).
Nested call support
{serverUrl}/servoy-service/rest_ws/mysolution/myscope/mymethod/mymethod2/arg1
The plugin will now lookup in mysolution
on the myscope
scope a method named ws_read_mymethod_mymethod2
; if that one is found it will call it with arg1
as an argument.
If ws_read_mymethod_mymethod2
method is not found it will try: ws_read_mymethod
(that will then get 2 arguments: mymethod2
and arg1
) and if that one is not found either it will fall back to ws_read
(with 3 arguments).
Read more about method arguments at Additional arguments
Pool of Clients
To service the requests to the RESTful Web service API, the plugin creates a pool of (headless) clients. The maximum number of clients allowed can be set using the rest_ws_plugin_client_pool_size
property of the plugin (default value = 5). If you have multiply rest solutions the property: rest_ws_plugin_client_pool_size_per_solution
can be used to set the pool size per solution. This latter property will set the rest_ws_plugin_client_pool_size
to -1. Because the max number will then be number of rest solutions multiplied by the per solution
.
When there are more concurrent requests than the number of clients in the pool, by default the requests will wait until a client becomes available in the pool. This behavior can be altered by setting the rest_ws_plugin_client_pool_exhausted_action
property of the plugin. The following values are supported for this property:
block (default): requests will wait until a client becomes available
fail: the request will fail. The API will generate a
SERVICE_UNAVAILABLE
response (HTTP 503)grow: allows the pool to grow, by starting additional clients. This will set the 2 pool size properties to -1 (so voiding both of them). And if the
rest_ws_plugin_client_pool_size_per_solution
is set then that will be used as the number of idle clients to keep per solution.
Servoy Cluster
The RESTful Web service plugin uses a pool of headless clients to service the requests. When operated within a Servoy Cluster, note that poolsize is set per Servoy Application Server.
Client plugin
Code running inside a rest-ws request can access the request and the response using the rest_ws client plugin.
For example, retrieve a custom header sent by the client:
Note that the client-plugin can only be used within a request handler, the function plugins.rest_ws.isRunningRequest()
can be used to check whether the code is running as a request hander.
See API documentation for the plugin.
Sample Solution
A sample solution is included in the Servoy distribution (servoy_sample_rest_ws.servoy
), detailing how to retrieve data from the HTTP Request and to return a response.
More information on RESTful Web Services
See the following links for more information on RESTful Web Services:
Last updated