How can we link some relevant data to a web page? Data such as: Air temp, Precipitation, Wind sensor.
Data comes from CR1000X and has two communications choices (WiFi and GPRS).
PUSH: send via (S)FTP or HTTP or email or..
Logger >-Eth-> Eth/WiFi-converter >-Internet-> Webserver (email, (S)FTP, HTTP POST/GET)
PULL: download via PC400/Loggernet and then use the machine that that is running on to PUSH to your website or use Campbells proprietary VPN solution Konect and get the data from there (no idea if they got an API you can use to pull data from though)
PS: I use the PULL version via Loggernet via OpenVPN/Wireguard and then use python scripts to push the data from the archival computer (can be a VM with Windows on the Internet) to send it on to a webserver for monitoring purposes. Needs a lot of time and knowledge to set up though..
Logger <-Eth-> 4G modem router <-VPN (Internet)-> Windows (Loggernet + python) <-Internet-> Webserver (python +..)
Big upside is, that I can access the Logger and his settings via VPN - change code, maintain stuff, etc. ;-)
How does the CR1000X get to WiFi or GPRS?
What is the on site device that converts it to Ethernet or what do you use?
..this determines if you can use a VPN solution or not, as the device needs to support it.
Hi there NICO!
so I have two connections to the station
2- GSM/GPRS (callback connection);
I mean as this station belongs to a airport, I created a balanced way to transmit data.
It means that if the wifi (NL241 on the stattion extendet to the Tower via Ubiquiti Nanobeam M2) fails there are GPRS modem connected to the logger that will transmit the data.
The wifi link is connected to the LAN.
Thank you NICO
OK, got ya. Have used Nanobeams myself, nice little units. You are aware that you can plug the Ethernet of that CR1000X directly into a nanobeam, yes? (would mean you can replace the NL241 with a Nanobeam)
What modem if I might ask?
I've been using Teltonika RUT95x and RUT240s at my jobs for a while now, which give you the option of not having to worry about where the WAN connection is comming from (2G/3G/4G or WiFi or Ethernet), see: https://wiki.teltonika-networks.com/view/RUT240_WAN
The logger connects to the modem via Ethernet and the modem deals with the WiFi/GSM/Ethernet part and gives the logger (or whatever LAN you got connected to it) the most preferrable access to the internet (=WAN).
So you would have the following hardware setup (i.e. you could get rid of the NL241):
Logger <-Eth-> ModemRouter <-WiFi/GSM-> ISP <-Internet-> Webserver
This still gives you all options of either the logger pushing data into the 'cloud' (sending it via email/(S)FTP/HTTP to a webserver) or some software pulling it from the logger (Konect or your own VM with a Loggernet server).
You need to program the logger to send the data..
- HTTPPost(), HTTPPut()
..your webserver on the other hand then needs to receive this data and do provide it to a webbroswer upon request.
- see https://www.konectgds.com/ (no idea if they have an API you can access if you need this info on your own webserver/website)
- if you can get a public IP for your GSM modem you can talk to it and the LAN behind it directly (see dynamic DNS + 'port forwarding' or IPsec).. but that is all not very secure, proceed at your own risk.
what I do:
- Virtual Machine from a webhoster with Windows10 on it and a Loggernet installation (data archival) and OpenVPN/wireguard client (or server if you don't have that eslewhere)
- Python3+ scripts that read the TOA5 dat files and send data to a webserver via HTTP POST/GET
- modem/router in the field supporting OpenVPN (or Wireguard) .. as mentioned Teltonika RUT240 for example
- webserver with Python3 (formerly I used PHP) that runs on a website (CPanel powered for me) which provides the data with graphs and things (I use CherryPy, Bottle, Bootstrap, Chart.js)
Using a (open source) VPN gives me the option of having access to ANY ethernet capable gear on the modem/router side of things. Imagine you having a IP camera with the logger and want to see that.. well, with my version I can access the camera as well, or any other gear like that.
Helo Nico! Morning.
I played with the most secure way to stablishe the comms on the moment.
The NanoBeans is connected directly to NL241 that is connected diretly to the Logger via serial port.
The GSM/GPRS device (Maestro E200 series) connects to logger via Logger Ethernet port. For more details of this wanderfull equipement please check its manual on the link below:
So I use as preferencial connection to the airport tower the wifi comm via NanoBean M2, for backup I use GSM/GPRS from Maestro device.
thank you Nico.
Hm.. the Meastro E200 website states under WiFi:
The E200 Series is originally built to be ready for the world with advanced technologies: Wi-Fi b/g/n, configurable Wi-Fi as WAN or access point, Wi-Fi Security (WEP / WPA / WPA2 Mixed Mode) and multiple SSID.
The quick manual you linked to (65) pages has no info on this.. you have to look up the real one with 220 pages (page 152, 11.3 Wifi, from here: https://www.dlmanuals.com/manual/maestro-e200-series/user-manual, v1.0):
Network > Wi-Fi
The router can work in 2 modes:
Wi-Fi as access point: It provides Internet to other host machines in its
network over Wi-Fi. It can get Internet connection from WAN or cellular.
Wi-Fi as client mode: the router will act as a client to existing wireless
networks. The router will accept the Internet access through wireless
access provided by another service provider and then distribute the
access to the machines connected to the router on its LAN interface.
Looking around further under 11.2 Load Balancing (page 130) this modem seems capable of using WiFi as a WAN source and can switch to 2G when the WiFi is down:
The default configuration of load balancer is in
Failover Mode with the highest priority given to
WAN, followed by WWAN and followed by Cellular.
WAN = Ethernet, wired (you don't have/use that)
WWAN = Wireless-WAN = WiFi in client mode, E200 links to Nanobeam and provides Internet to Logger via it's LAN port
Cellular = 2G, E200 links to mobile tower and provides Internet to Logger via its LAN port
.. needs testing, but from here it looks like you can take the NL241 out of the system (saves power and space).
After that you need to decide on how you want to go with the data.. pull or push, etc?
It even is OpenVPN capable, so you can do a lot with this (if you get OpenVPN running that is ;-).
PS: a v2.3 of the manual is located here: https://www.manualslib.com/download/1535096/Maestro-E200.html
PPS: from personal experience.. use the System>Schedule Reboot option (once a week is normal for the modems I work with to stay on the safe side), but that's only mentioned in v2.3 of the manual, v1.0 doesn't have it. Might need a firmware upgrade of your modem if you don't have that menu point I guess?
It sounds like Nico has answered this pretty well, but I just wanted to share what we do incase it helps to give ideas:
I have LoggerNet execute a python script after it collects from our weather stations that sends all the data to a timeseries database. We've got Grafana tied to the database so we can do the real time plotting, and if we need to we can embed plots directly from Grafana. It's probably not the best way of doing that sort of thing, but it works really well for us. Essentially:
Weather Stations -> LoggerNet -> Python -> InfluxDB -> Grafana -> End User