Time to Revamp MFM Maps Downloads?

[shawchyn]

Just my opinion:

If members want to download now or later is at their own choice. As for contributors, there are many kind of them. We can classify/categories it in many different ways. But for the active contributors, they sure need the latest map for the frequent updates. This will make MFM map more up-to-date map and ahead of the competitors. We can update every six month if that what the members want but please be aware that there are many changes that occur everyday - eg road closed, street flow direction, new ramp, new housing areas, mistakes make by mappers/other contributors (including myself), areas that have been tracked or not yet tracked by other members, POIs included in the map or not yet included, etc.

So we need the frequently updated map so that we can plan our tracking activities and make MFM stay ahead.
BTW, why this thing happen after Bro Antyong left. Before that it was NOT an issue at all.

Well said bro tuah.

Only one thing not agreed is this download speed issue is not only happen after bro antyong left. It is always happen and we always fight to dig out more bandwidth. Especially, when MfM getting more an more people to use, this increase the traffic whenever the maps are release.

For the current situation, some 'unhappy' members most likely are not from SG or MY. This is due to their traffic will directly diverted to other public share service.

[purpleray]

Just my opinion:

If members want to download now or later is at their own choice. As for contributors, there are many kind of them. We can classify/categories it in many different ways. But for the active contributors, they sure need the latest map for the frequent updates. This will make MFM map more up-to-date map and ahead of the competitors. We can update every six month if that what the members want but please be aware that there are many changes that occur everyday - eg road closed, street flow direction, new ramp, new housing areas, mistakes make by mappers/other contributors (including myself), areas that have been tracked or not yet tracked by other members, POIs included in the map or not yet included, etc.

So we need the frequently updated map so that we can plan our tracking activities and make MFM stay ahead.
BTW, why this thing happen after Bro Antyong left. Before that it was NOT an issue at all.

totally agree...
who are not involved in contribution.. please please understand ..we need the frequently updated map because we dont want any double tracking where waste our time and energy...

[aikliang]

I started this thread to address and brain-storm on bandwidth issues that bro shawchyn and chaicka were experiencing. After some posts by other members, I think the issue of band-width is now more manageable.

As more and more members join mfm and more and more people start using GPS, the demand for maps especially the up-dated maps will exponentially increase. Whether bro Antyong is still with us or not, the band-width issues had to be addressed.

Regards the up-dated maps, I am in agreement with bro Tuah and anybody who contributes to the maps that we need up-dated maps to carry out our work. But being Malaysian (and Singaporean) , we all want to show off and have the latest toys available. So if we cannot stop them (the casual users and down-loaders) from downloading the maps on a weekly basis, at the very least, we can point them to other alternatives so as not to congest bro shawchyn and bro chaicka servers and bandwidth. I think the mappers need them to up-load the maps.

Due to inflation and rise in the foreign exchange, my 2-sen is now worth 5 sen...

[chaicka]

Again, the problems that we facing the bandwidth issue is, all the user want to get their update as early as possible. With the change logs or not, they still will download it. So, they are actually 2 other solutions can be work on:
1. Purchase more bandwidth, mean more money.
2. More servers to serve. Mean need more bros & sis out there who have server where we can use their bandwidth for free.
3. Ask member to download the maps later? Never work. So, not a solutions.

With the current script that I had done, it is manage the bandwidth much better. We had significan reduce the "unwanted" bandwidth that come from China, Indonesia, and US.

From the statistic that I had, the best time to download is the 2nd day of the maps release. This is due to we actually have more servers to serve on the 2nd day.

Truly agrees with bro shaw and he really understands web hosting and audience mentality. Even without initial rush to download, the overall monthly traffic volume is still huge.

The issue on hand are actually 2 areas:
a. Speed of Download - this is due to mad rush to download on first day of release and thus all initial servers that host the newest map will get choked.
b. Traffic Volume of Download - the overall increase in awareness of MFM map and that it's a great map for ASEAN has grow the volume of download to a huge amount per month.

Bro Shaw, with the script on your mirror, it has resulted in those 'unexpected' traffic from China, US, Middle East, etc to come to my SG mirror (due to no restriction set on their ip ranges yet). For June traffic report on SG mirror (up till 23rd June 2010), it has reached high heights - >200GB.

Based on the continuous collaboration we had, the conclusion I can think of are as follows:
a. The demand on monthly total traffic volume of all hosting/mirrors will just be increasing. The effort we did for the past 1-2 months just redirect the traffic around the hosting/mirrors.
b. MFM map is getting worldwide recognition, which is a great thing for MFM and its community.

One of the forumer, who runs a software house, has offered his assistance to MFM. I have initiated to see how we can set up a discussion. Let's see how far we can go.

[chaicka]

Just a thought on how to tackle the issue with long term manageability.

Content/File Management System Framework:
- Independent from the phpBB forum s/w
- Access Control tap into (read from) phpBB's user database - to manage access rights for configuration, uploading, file deletion, etc (no user account manageability)
- Web GUI - based on php and mySQL
- Functions
...# configure list of mirrors' URL (parent suffix)
...# upload of map releases by MFM Administrators (assume the master map compilers are in this group)
...# automatically rsync/ftp to list of mirrors
...# publish latest map release to download page (centralized single page where audience will go to)
...# smart mechanism build into download page to redirect downloaders based on their ip address to the nearest mirror (the mirror URL/parent suffix + the latest map release filename)

Advantages:
a. Smart redirect of traffic to nearest mirror based on downloaders' ip address would means optimized internet traffic without need to cross the borders, thus improved speed of download.
b. Ease of File Management means easier for MFM Administrators/Master Map Compilers to upload map releases without having to do so to all mirrors (imagine if MFM grow to have 5 to 10 mirrors)
c. Centralized Single Download Page means reduced possibility to circumvent our traffic management efforts (all mirrors need to configure their hosting to allow hotlink only from the master download page's URL).

[chaicka]

Just to link to another thread on same topic:
viewtopic.php?f=4&t=8259

I have shared my opinion on how to approach, and a forumer has offer to help materialize it (hopefully it's feasible). Let's see how things go.

[aikliang]

dear mods, can we combine the two threads, they are essentially discussing the same issues. Thanks.

[tympg]

dear mods, can we combine the two threads, they are essentially discussing the same issues. Thanks.

Done.

[kaybee]

I can't even download latest file 100705 to check whether all my submission are correctly incorporated as intended. Malaysia link sent me to google docs that said bandwidth exceeded. Singapore link says forbidden. Could someone pls look into all these download restriction control

[moeyhc]

Good Morning and cool down.... Like to share my few cents on this download thing....

If we care about the "Few" real contributors who really need to know where to track with the new up date than may I suggest you guys form a 'Small Close Group' (SCG - you guys decide who Qualified) and be given the link to the weekly update. Either one of these guys Shawchyn, adrianyujs, chaick & etc will host a separate link and PM the link to 'The Contributors'. The rest of the World will use the open forum links to download. My experience is the download works fine when it is done on a Tuesday or Wednesday.... why rush?